Skip to content
mini-lab
Features of prelude-2

Feature #3576

Fires on “<|bos|>” (not labeled yet: read the examples)

Fires on
0.66% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 29%
  • story 26%
  • agent 25%
  • python 10%
  • worksheet 10%

Makes the model say

itemall` name numbersovekehing

Makes it not say

]) too returns betteri so on So

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 14.02
    they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
  2. agent 13.94
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  3. story 13.9
    make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
  4. chat 13.88
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>Who made you
  5. agent 13.85
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  6. story 13.85
    about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|>Lila and Sam were
  7. agent 13.83
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  8. worksheet 13.83
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Lily has 3
  9. agent 13.82
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  10. worksheet 13.8
    Would you like a story, or some numbers to add?<|assistant_end|><|bos|>Compute 26
  11. agent 13.79
    about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  12. agent 13.79
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit