Feature #419
Fires on “<|bos|>” (not labeled yet: read the examples)
- Fires on
- 0.70% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 29%
- story 26%
- agent 25%
- python 10%
- worksheet 10%
Makes the model say
One```<|tool_call_start|>icked5 asked "
Makes it not say
always time hand stillee sun was turned
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 11.97they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
-
chat 11.79about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>Write a short
-
python 11.78about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|>Bug: `greet
-
chat 11.77about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>Answer in one
-
story 11.77, edit and fix the Python files in this project.<|assistant_end|><|bos|>Once upon a time
-
chat 11.77tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>Answer in one
-
python 11.76the Python files in this project.<|assistant_end|><|bos|># app.py
-
story 11.75that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Once upon a time
-
chat 11.75, create, edit and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>Hey<|user_end|><|assistant_start|>
-
agent 11.74about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
-
agent 11.73return a * b`. The tests pass now.<|assistant_end|><|bos|><|system_start|>tools: edit
-
agent 11.73that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit