Feature #1375
Fires on “<|bos|>” (not labeled yet: read the examples)
- Fires on
- 0.68% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 30%
- story 25%
- agent 25%
- worksheet 10%
- python 10%
Makes the model say
<|user_start|>/ PythondeHeyllotenopencode
Makes it not say
s made hard momic big Tim
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 20.81that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>Who made you
-
story 20.67they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
-
agent 20.66that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
-
agent 20.64that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
-
agent 20.61that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
-
story 20.6make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
-
story 20.56and how to add numbers. Try asking me for a story!<|assistant_end|><|bos|>Once upon a time
-
python 20.52children and add numbers, step by step or with a calculator.<|assistant_end|><|bos|># test_stats
-
chat 20.52instead of `if a > b:`. The tests pass now.<|assistant_end|><|bos|><|system_start|>Start every answer
-
agent 20.49that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
-
story 20.48that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Lily and Ben were
-
story 20.46children and add numbers, step by step or with a calculator.<|assistant_end|><|bos|>Once upon a time