Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1958

Fires on “ don” (not labeled yet: read the examples)

Fires on
1.10% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 41%
  • story 24%
  • chat 18%
  • python 16%
  • worksheet 1%

Makes the model say

'tAddedpyned itemious8calculator

Makes it not say

roomut mom Thankay house sun party

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.21
    iet<|user_end|><|assistant_start|>Sorry, I don't know about that
  2. chat 3.89
    space.<|user_end|><|assistant_start|>Sorry, I don't know about that
  3. chat 3.85
    ed the telephone<|user_end|><|assistant_start|>Sorry, I don't know about that
  4. chat 3.85
    ather like in Berlin today?<|user_end|><|assistant_start|>Sorry, I don't know about that
  5. chat 3.77
    <|bos|><|user_start|>What should I invest in?<|user_end|><|assistant_start|>Sorry, I don't know about that
  6. chat 3.7
    wrote Romeo and Juliet?<|user_end|><|assistant_start|>Sorry, I don't know about that
  7. chat 3.69
    <|bos|><|user_start|>How far away is the moon?<|user_end|><|assistant_start|>Sorry, I don't know about that
  8. chat 3.64
    what is the tallest mountain in the world<|user_end|><|assistant_start|>Sorry, I don't know about that
  9. chat 3.63
    What is 12 times 8?<|user_end|><|assistant_start|>Sorry, I don't know about that
  10. chat 3.59
    How do I learn French fast?<|user_end|><|assistant_start|>Sorry, I don't know about that
  11. story 3.59
    , don't cry. It
  12. chat 3.54
    .<|bos|><|user_start|>Where is London?<|user_end|><|assistant_start|>Sorry, I don't know about that