Feature #1000
Fires on “<|bos|>” (not labeled yet: read the examples)
- Fires on
- 1.11% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 31%
- agent 25%
- story 25%
- worksheet 10%
- python 10%
Makes the model say
OnceAddedontRenamedWritegth<|tool_call_start|> VALUES
Makes it not say
in be big. friends all he and
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 13.46they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
-
agent 13.35on, they had many fun adventures.<|assistant_end|><|bos|><|system_start|>tools: edit
-
story 13.21make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
-
chat 13.19could have with her toys. And they all lived happily ever after.<|bos|><|system_start|>tools: calculator
-
agent 13.12it's better to share and be together than to be separate.<|bos|><|system_start|>tools: edit
-
agent 13.05crazy string. She played with her new toy all day long.<|assistant_end|><|bos|><|system_start|>tools: edit
-
story 13.05that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Once upon a time
-
agent 13.02that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
-
story 13.02and Sue and Tim learned that sharing with others can make everyone happy.<|bos|>Once upon a time
-
story 13.02also very careful with the marbles the next time he played.<|bos|>Once upon a time
-
chat 13.01another, there will be fewer disagreements.<|bos|><|system_start|>tools: calculator
-
python 13.01everyone wants help, and sometimes it is better to leave them alone.<|bos|># main.py