Skip to content
mini-lab
Features of prelude-2

Feature #3435

Fires on “ numbers” (not labeled yet: read the examples)

Fires on
0.12% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 80%
  • agent 11%
  • python 6%
  • story 2%
  • worksheet 0%

Makes the model say

numbers. andure, function passed backwards

Makes it not say

itemoo soont helpisiced

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.85
    I'm a tiny model: I can only tell short stories and add numbers.<|assistant_end|><|user_start|>What
  2. chat 4.84
    't help with that. I only know how to tell stories and add numbers.<|assistant_end|><|user_start|>what
  3. chat 4.83
    don't know about that. I can only tell short stories and add numbers.<|assistant_end|><|user_start|>What
  4. chat 4.79
    don't know about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>
  5. chat 4.79
    't help with that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Bug
  6. chat 4.79
    I'm a tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>
  7. chat 4.78
    I'm a tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|>Once
  8. chat 4.78
    I'm a tiny model: I can only tell short stories and add numbers.<|assistant_end|><|user_start|>What
  9. chat 4.78
    't help with that. I only know how to tell stories and add numbers.<|assistant_end|><|user_start|>What
  10. chat 4.78
    don't know about that. I can only tell short stories and add numbers.<|assistant_end|><|user_start|>t
  11. chat 4.78
    't help with that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Once
  12. chat 4.77
    't help with that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Once