Skip to content
mini-lab
Features of prelude-2

Feature #1002

Fires on “ don” (not labeled yet: read the examples)

Fires on
0.47% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 51%
  • chat 28%
  • agent 9%
  • worksheet 9%
  • python 4%

Makes the model say

!" first out -."``` +⏎

Makes it not say

laugh Tom splash<|system_start|>_*. Fluffy helpingultipl

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.3
    ain in the river? It is here to protect you, if you don't watch out,
  2. chat 5.25
    ed the telephone<|user_end|><|assistant_start|>Sorry, I don't know about that
  3. story 5.14
    crab said, "I want to go to a party, but I don't know how to
  4. story 5.09
    of the story is that sharing can make everyone happy, even when things don't go as plan
  5. chat 5.07
    ?" The big truck said, "I'm sorry, Spot. I don't have any o
  6. story 5.04
    to the living room. But be careful, they are hot and you don't want to sp
  7. chat 5.02
    what is the tallest mountain in the world<|user_end|><|assistant_start|>Sorry, I don't know about that
  8. chat 4.95
    iet<|user_end|><|assistant_start|>Sorry, I don't know about that
  9. chat 4.94
    the capital of Brazil?<|user_end|><|assistant_start|>Sorry, I don't know about that
  10. chat 4.92
    wrote Romeo and Juliet?<|user_end|><|assistant_start|>Sorry, I don't know about that
  11. chat 4.88
    <|user_start|>What is the meaning of life?<|user_end|><|assistant_start|>Sorry, I don't know about that
  12. chat 4.87
    ather like in Berlin today?<|user_end|><|assistant_start|>Sorry, I don't know about that