Skip to content
mini-lab
Features of prelude-2

Feature #2625

Fires on “ friends” (not labeled yet: read the examples)

Fires on
0.99% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 75%
  • chat 10%
  • agent 10%
  • worksheet 3%
  • python 2%

Makes the model say

. who." forever<|bos|> too learned liked

Makes it not say

schema Thennewsist thenhesly⏎

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.45
    7 = 91540<|bos|>Tom and Mia were best friends. They lived next
  2. story 4.21
    790<|think_end|>790<|assistant_end|><|bos|>Lily and Ben are friends. They like to
  3. story 4.18
    They became friends and liked to play
  4. story 4.14
    7 = 92725.<|bos|>Lily and Tom are friends. They like to
  5. story 4.1
    <|think_end|>The answer is 78.<|assistant_end|><|bos|>Tom and Sam are friends. They like to
  6. story 4.09
    to tell stories and add numbers.<|assistant_end|><|bos|>Anna and Lily were best friends. They liked to
  7. story 4.01
    _stats.py⏎all tests passed⏎<|bos|>Tom and Jen are friends. They like to
  8. story 3.97
    4, 9])⏎9⏎<|bos|>Tom and Ann are friends. They like to
  9. story 3.95
    best eggs ever.⏎The end.<|bos|>Lily and Ben were best friends. They liked to
  10. story 3.94
    =6, 6<|think_end|>6<|assistant_end|><|bos|>Lily and Tom were best friends. They liked to
  11. story 3.87
    they had many fun adventures together.<|assistant_end|><|bos|>Ben and Sam were best friends. They liked to
  12. story 3.85
    very happy to have each other as friends.<|bos|>Tom and Lily are friends. They like to