Skip to content
mini-lab
Features of prelude-2

Feature #2765

Fires on “ little” (not labeled yet: read the examples)

Fires on
0.34% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 75%
  • chat 22%
  • agent 2%
  • python 1%
  • worksheet 0%

Makes the model say

sun a little idea after, ret

Makes it not say

<|assistant_end|><|tool_end|><|arg|> exclamation<|system_start|>json`,⏎

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.67
    <|bos|>One day, a little ball named Bou
  2. story 4.48
    <|bos|>Once upon a time, there was a little car named Spe
  3. story 4.48
    <|bos|>Once upon a time, there was a little girl who lived on
  4. story 4.48
    <|bos|>Once upon a time, there was a little train. The train
  5. story 4.48
    <|bos|>Once upon a time, there was a little girl named Sue.
  6. story 4.45
    1799.<|bos|>Once upon a time, there was a little boy named Tim.
  7. story 4.39
    Lucy for making it look so pretty.<|bos|>One day, a little cat named Q
  8. story 4.39
    + 73 = 82.<|bos|>One day, a little girl named Sue went
  9. story 4.39
    in this project.<|assistant_end|><|bos|>Once upon a time, there was a little squirrel named Sam.
  10. story 4.39
    82347 apples.<|bos|>One day, a little girl named Mia went
  11. story 4.37
    and add numbers.<|assistant_end|><|bos|>Once upon a time, there was a little boy named Tim.
  12. story 4.37
    tests pass now.<|assistant_end|><|bos|>Once upon a time, there was a little girl named Sue.