Skip to content
mini-lab
Features of prelude-2

Feature #3372

Fires on “ friends” (not labeled yet: read the examples)

Fires on
0.98% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 70%
  • chat 16%
  • agent 13%
  • worksheet 1%
  • python 1%

Makes the model say

who,. and whats again then

Makes it not say

schema<|assistant_end|> "$aeiourunByeopencoderied

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 7.36
    7 = 91540<|bos|>Tom and Mia were best friends. They lived next
  2. story 7.29
    a time, there was a girl called Amy. She was a happy girl who liked to play
  3. story 7.04
    to tell stories and add numbers.<|assistant_end|><|bos|>Anna and Lily were best friends. They liked to
  4. story 6.94
    tell short stories and add numbers.<|assistant_end|><|bos|>Lila and Sam were best friends. They liked to
  5. story 6.77
    =6, 6<|think_end|>6<|assistant_end|><|bos|>Lily and Tom were best friends. They liked to
  6. story 6.76
    forest, there was a little girl named Lucy. Lucy was a dependable girl who always kept her
  7. story 6.64
    they had many fun adventures together.<|assistant_end|><|bos|>Ben and Sam were best friends. They liked to
  8. story 6.5
    to tell stories and add numbers.<|assistant_end|><|bos|>Lily and Ben were best friends. They liked to
  9. story 6.49
    a time, there was a boy named Tim. Tim was a happy boy who loved to smile
  10. story 6.43
    of x, rounded down.<|assistant_end|><|bos|>Ben and Lily were best friends. They liked to
  11. story 6.41
    a time, there was a girl named Lily. Lily was a bossy girl. She liked to
  12. story 6.29
    named Bob wanted to fly high in the sky. Bob was a happy bird who lived in a