Skip to content
mini-lab
Features of prelude-2

Feature #227

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.38% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 71%
  • chat 26%
  • agent 3%
  • worksheet 0%
  • python 0%

Makes the model say

little boy and small girl happy nice

Makes it not say

`[ion named "!"oveconfigmincont

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.04
    when she went exploring.<|bos|>One day, a little boy named Tim
  2. story 4.97
    be more careful with his toy weapon.<|bos|>One day, a cat named Bow
  3. story 4.91
    Lucy for making it look so pretty.<|bos|>One day, a little cat named
  4. story 4.87
    a story, or some numbers to add?<|assistant_end|><|bos|>One day, a strong boy named Tom
  5. story 4.86
    <|bos|>One day, a little ball named B
  6. story 4.85
    8<|think_end|>The answer is 8.<|assistant_end|><|bos|>One day, a little girl named Lily
  7. story 4.84
    found the big, shiny balloon in the tree.<|bos|>One day, a little boy named Tim
  8. story 4.84
    can only tell short stories and add numbers.<|assistant_end|><|bos|>One day, a little girl named Sue
  9. story 4.83
    843.<|assistant_end|><|bos|>One day, a boy named Tim went
  10. story 4.83
    <|think_end|>The answer is 537.<|assistant_end|><|bos|>One day, a lively girl named
  11. story 4.81
    Lucy has 11626 toys.<|bos|>One day, a smart girl named Lisa
  12. story 4.76
    <|tool_end|><|assistant_start|>The answer is 53.<|assistant_end|><|bos|>One day, a little girl named Mia