Feature #3374
Fires on “.” (not labeled yet: read the examples)
- Fires on
- 0.32% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 69%
- chat 18%
- story 8%
- worksheet 5%
- python 1%
Makes the model say
mdfrom calculatorHello remembercase`,
Makes it not say
test got came foundp morean sorry
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 1.91<|assistant_end|><|user_start|>Add 1 to it.<|user_end|><|assistant_start|><|think_start|>5
-
story 1.84walked up and down the path, Mia spotted something purple.⏎"Mommy, look! It
-
chat 1.84large, black dog, he trembled with fear.⏎"Mommy, the doggy
-
story 1.81little bird. The bird was helpless and could not fly. "Mom, look!" Mia
-
chat 1.8is 108.<|assistant_end|><|user_start|>Add 61 to it.<|user_end|><|assistant_start|><|tool_call_start|>calculator
-
chat 1.72answer is 24.<|assistant_end|><|user_start|>Add 80 to it.<|user_end|><|assistant_start|><|think_start|>2
-
chat 1.71is 116.<|assistant_end|><|user_start|>Add 56 to it.<|user_end|><|assistant_start|>The answer
-
chat 1.7is 149.<|assistant_end|><|user_start|>Add 17 to it.<|user_end|><|assistant_start|><|think_start|>1
-
chat 1.69answer is 11.<|assistant_end|><|user_start|>Add 42 to it.<|user_end|><|assistant_start|><|tool_call_start|>calculator
-
chat 1.68answer is 188.<|assistant_end|><|user_start|>Add 2 to it.<|user_end|><|assistant_start|><|tool_call_start|>calculator
-
chat 1.65answer is 78.<|assistant_end|><|user_start|>Add 56 to it.<|user_end|><|assistant_start|><|think_start|>7
-
chat 1.65is 149.<|assistant_end|><|user_start|>Add 18 to it.<|user_end|><|assistant_start|>The answer