Skip to content
mini-lab
Features of prelude-2

Feature #1943

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.73% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 48%
  • chat 28%
  • agent 23%
  • python 2%
  • worksheet 0%

Makes the model say

a named big bed dog proud re=

Makes it not say

files why<|assistant_end|>=**/*. typo,"Renamed moral

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.02
    files in this project.<|assistant_end|><|bos|>Once upon a time, there was a nosy bee named P
  2. story 3.93
    <|assistant_end|><|bos|>Once upon a time, there was a big giant. He
  3. story 3.9
    0.<|assistant_end|><|bos|>Once upon a time, there was a curious little girl named
  4. story 3.88
    <|bos|>Once upon a time, there was a little car named S
  5. story 3.88
    <|bos|>Once upon a time, there was a little girl who lived
  6. story 3.88
    <|bos|>Once upon a time, there was a little train. The
  7. story 3.88
    <|bos|>Once upon a time, there was a little girl named Sue
  8. story 3.88
    <|bos|>Once upon a time, there was a girl named Lucy.
  9. story 3.88
    files in this project.<|assistant_end|><|bos|>Once upon a time, there was a big red barn on
  10. story 3.87
    some numbers to add?<|assistant_end|><|bos|>Once upon a time, there was a little girl named Sue
  11. story 3.85
    is 70.<|assistant_end|><|bos|>Once upon a time, there was a small cat named Tom
  12. story 3.85
    .<|assistant_end|><|bos|>Once upon a time, there was a jolly cat named Sam