Feature #3413
Fires on “1” (not labeled yet: read the examples)
- Fires on
- 0.59% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 69%
- worksheet 22%
- agent 5%
- story 3%
- python 1%
Makes the model say
if odd <oodreethaeiou whether
Makes it not say
with rve s fun[, one
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 2.5798<|tool_call_end|><|assistant_end|><|tool_start|>136<|tool_end|><|assistant_start|>The answer is 136.<|assistant_end|>
-
chat 2.5465<|tool_call_end|><|assistant_end|><|tool_start|>173<|tool_end|><|assistant_start|>The answer is 173.<|assistant_end|>
-
chat 2.5258 + 55 is?<|user_end|><|assistant_start|>The answer is 113.<|assistant_end|>
-
chat 2.537 and 731.<|user_end|><|assistant_start|>The answer is 1368.
-
chat 2.557 + 43 is?<|user_end|><|assistant_start|>The answer is 100.<|assistant_end|>
-
chat 2.4896<|tool_call_end|><|assistant_end|><|tool_start|>149<|tool_end|><|assistant_start|>The answer is 149.<|assistant_end|>
-
chat 2.475 and 79 for me?<|user_end|><|assistant_start|>The answer is 154.<|assistant_end|>
-
chat 2.46+9=17, 17<|think_end|>The answer is 17.<|assistant_end|><|bos|>
-
chat 2.4661<|tool_call_end|><|assistant_end|><|tool_start|>169<|tool_end|><|assistant_start|>The answer is 169.<|assistant_end|>
-
chat 2.44and 406 for me?<|user_end|><|assistant_start|>The answer is 1243.
-
chat 2.4421 and 324.<|user_end|><|assistant_start|>The answer is 1145.
-
chat 2.43How many shells does Ben have now?<|user_end|><|assistant_start|>The answer is 158.<|assistant_end|>