Skip to content
mini-lab
Features of prelude-2

Feature #3597

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.54% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 77%
  • chat 20%
  • python 2%
  • agent 1%
  • worksheet 0%

Makes the model say

little big play small Mr boy pretty front

Makes it not say

then<|assistant_end|>Rename<|user_end|><|tool_start|><|system_end|>ely list

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.84
    8<|think_end|>The answer is 8.<|assistant_end|><|bos|>One day, a little girl named Lily
  2. story 2.83
    <|tool_end|><|assistant_start|>The answer is 53.<|assistant_end|><|bos|>One day, a little girl named Mia
  3. story 2.8
    giant's house. The boy was not scared. He said, "Hello, I am Sam
  4. chat 2.8
    shrimp was swimming, a big fish appeared.⏎"Hello, little shrimp
  5. story 2.79
    can only tell short stories and add numbers.<|assistant_end|><|bos|>One day, a little girl named Sue
  6. chat 2.78
    short story about a cake<|user_end|><|assistant_start|>One day, a little boy named Tim
  7. story 2.78
    <|think_end|>The answer is 537.<|assistant_end|><|bos|>One day, a lively girl named
  8. story 2.77
    be more careful with his toy weapon.<|bos|>One day, a cat named Bow
  9. story 2.75
    . Tim wanted to talk to the dog, so he said, "Hi, dog! My
  10. story 2.74
    <|assistant_start|>The answer is 738.<|assistant_end|><|bos|>One day, a little boy named Tim
  11. story 2.72
    ⏎```<|assistant_end|><|bos|>One day, a girl named Mia found
  12. story 2.72
    <|tool_end|><|assistant_start|>The answer is 51.<|assistant_end|><|bos|>One day, a little boy named Tim