Skip to content
mini-lab
Features of prelude-2

Feature #1686

Fires on “<|bos|>” (not labeled yet: read the examples)

Fires on
0.63% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 29%
  • story 26%
  • agent 25%
  • python 10%
  • worksheet 10%

Makes the model say

pythonOne1keI OneWhatnder

Makes it not say

dropped gets". agreed`. tooin!"

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 9.97
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  2. agent 9.97
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  3. agent 9.94
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  4. python 9.93
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|>Bug: `lower
  5. chat 9.92
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>Who made you
  6. agent 9.92
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  7. worksheet 9.92
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|>What's 5
  8. story 9.91
    , edit and fix the Python files in this project.<|assistant_end|><|bos|>Once upon a time
  9. chat 9.9
    about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>Answer in one
  10. chat 9.89
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>How can you
  11. story 9.88
    0: 6+0=6, 6<|think_end|>6<|assistant_end|><|bos|>Lily and Tom were
  12. agent 9.88
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit