Skip to content
mini-lab
Features of prelude-2

Feature #1000

Fires on “<|bos|>” (not labeled yet: read the examples)

Fires on
1.11% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 31%
  • agent 25%
  • story 25%
  • worksheet 10%
  • python 10%

Makes the model say

OnceAddedontRenamedWritegth<|tool_call_start|> VALUES

Makes it not say

in be big. friends all he and

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 13.46
    they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
  2. agent 13.35
    on, they had many fun adventures.<|assistant_end|><|bos|><|system_start|>tools: edit
  3. story 13.21
    make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
  4. chat 13.19
    could have with her toys. And they all lived happily ever after.<|bos|><|system_start|>tools: calculator
  5. agent 13.12
    it's better to share and be together than to be separate.<|bos|><|system_start|>tools: edit
  6. agent 13.05
    crazy string. She played with her new toy all day long.<|assistant_end|><|bos|><|system_start|>tools: edit
  7. story 13.05
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Once upon a time
  8. agent 13.02
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  9. story 13.02
    and Sue and Tim learned that sharing with others can make everyone happy.<|bos|>Once upon a time
  10. story 13.02
    also very careful with the marbles the next time he played.<|bos|>Once upon a time
  11. chat 13.01
    another, there will be fewer disagreements.<|bos|><|system_start|>tools: calculator
  12. python 13.01
    everyone wants help, and sometimes it is better to leave them alone.<|bos|># main.py