Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2100

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.33% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 57%
  • chat 33%
  • agent 4%
  • python 4%
  • worksheet 1%

Makes the model say

time day<|arg|> equalskpy beutils

Makes it not say

)!")th5")opencode cr"

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.17
    you tell me a story about a fish?<|user_end|><|assistant_start|>Once upon a time, in a
  2. chat 3.13
    <|user_start|>Once upon a time...<|user_end|><|assistant_start|>Sure! Once upon a time, there was
  3. chat 3.12
    <|assistant_end|><|user_start|>I want a story about a fish!<|user_end|><|assistant_start|>Once upon a time, there was
  4. chat 3.12
    a cake?<|user_end|><|assistant_start|>Once upon a time, there was
  5. chat 3.12
    4.<|assistant_end|><|user_start|>Write a story for me.<|user_end|><|assistant_start|>Once upon a time, there was
  6. story 3.12
    said. The other rats were excited too and they all had a great time.⏎They
  7. chat 3.11
    49.<|assistant_end|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time, there was
  8. chat 3.09
    Can you tell me a story about a car?<|user_end|><|assistant_start|>Once upon a time, there was
  9. chat 3.09
    book.<|assistant_end|><|user_start|>Tell me a short story.<|user_end|><|assistant_start|>Once upon a time, in a
  10. chat 3.09
    want a story about the sea!<|user_end|><|assistant_start|>Sure! Once upon a time, in a
  11. chat 3.09
    Can you tell me a story about the sun?<|user_end|><|assistant_start|>Once upon a time, there was
  12. chat 3.08
    numbers.<|assistant_end|><|user_start|>Write a story for me.<|user_end|><|assistant_start|>Once upon a time there was a