Skip to content
mini-lab
Features of prelude-2

Feature #1780

Fires on “<|bos|>” (not labeled yet: read the examples)

Fires on
0.87% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 29%
  • agent 26%
  • story 26%
  • worksheet 10%
  • python 10%

Makes the model say

OnceOneis numberic#Sara positive

Makes it not say

348 v asing9ged

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 10.6
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  2. chat 10.45
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>Who made you
  3. agent 10.44
    about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  4. chat 10.42
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>Answer with the
  5. story 10.41
    ways to remember important things, so we don't let others down.<|bos|>Once upon a time
  6. agent 10.34
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  7. story 10.34
    make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
  8. chat 10.34
    about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>Answer in one
  9. agent 10.32
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  10. chat 10.32
    small leaf learned that sometimes you need to let go to help others.<|bos|><|user_start|>Sam has
  11. agent 10.31
    about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  12. chat 10.3
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>How can you