Feature #1743
Fires on “2” (not labeled yet: read the examples)
- Fires on
- 0.89% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 75%
- worksheet 20%
- agent 4%
- story 1%
- python 0%
Makes the model say
.main absolute see who+ier very
Makes it not say
Set pytest't lenesThank
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 4.0have now?<|user_end|><|assistant_start|>The answer is 121.<|assistant_end|><|user_start|>
-
chat 3.95for me?<|user_end|><|assistant_start|>The answer is 116.<|assistant_end|><|user_start|>
-
chat 3.92that?<|user_end|><|assistant_start|>The answer is 152.<|assistant_end|><|user_start|>
-
chat 3.84<|assistant_start|>The answer is 108.<|assistant_end|><|user_start|>Add
-
chat 3.833?<|user_end|><|assistant_start|>The answer is 104.<|assistant_end|><|user_start|>
-
chat 3.8<|tool_call_end|><|assistant_end|><|tool_start|>320<|tool_end|><|assistant_start|>The answer is 320.<|assistant_end|><|bos|><|system_start|>
-
chat 3.78is 8 + 6?<|user_end|><|assistant_start|>The answer is 14.<|assistant_end|><|user_start|>Now
-
chat 3.74and 17?<|user_end|><|assistant_start|>The answer is 21.<|assistant_end|><|user_start|>Could
-
chat 3.7<|user_end|><|assistant_start|>The answer is 1420.<|assistant_end|><|user_start|>
-
chat 3.68if I add 37?<|user_end|><|assistant_start|>The answer is 37.<|assistant_end|><|user_start|>Now
-
chat 3.66.<|assistant_end|><|user_start|>Plus 3?<|user_end|><|assistant_start|>The answer is 25.<|assistant_end|><|user_start|>he
-
chat 3.65The answer is 14.<|assistant_end|><|bos|>Bug