Skip to content
mini-lab
Features of prelude-2

Feature #1059

Fires on “ little” (not labeled yet: read the examples)

Fires on
0.32% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 41%
  • python 23%
  • worksheet 18%
  • chat 10%
  • agent 8%

Makes the model say

= kationP1 picked Kittyopencode

Makes it not say

ning's biggest Try asksreat9twice

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.52
    <|bos|>One day, a little ball named Bou
  2. story 2.49
    82347 apples.<|bos|>One day, a little girl named Mia went
  3. story 2.47
    + 73 = 82.<|bos|>One day, a little girl named Sue went
  4. story 2.46
    8<|think_end|>The answer is 8.<|assistant_end|><|bos|>One day, a little girl named Lily was
  5. story 2.45
    when she went exploring.<|bos|>One day, a little boy named Tim was
  6. story 2.44
    Lucy for making it look so pretty.<|bos|>One day, a little cat named Q
  7. story 2.44
    The answer is 738.<|assistant_end|><|bos|>One day, a little boy named Tim found
  8. story 2.44
    <|assistant_start|>The answer is 53.<|assistant_end|><|bos|>One day, a little girl named Mia went
  9. story 2.42
    85 = 8745.<|bos|>One day, a little boy named Timmy was
  10. story 2.39
    only tell short stories and add numbers.<|assistant_end|><|bos|>One day, a little girl named Sue found
  11. story 2.38
    9 = 74763.<|bos|>One day, a little boy named Tim went
  12. story 2.36
    <|assistant_start|>The answer is 51.<|assistant_end|><|bos|>One day, a little boy named Tim wanted