Feature #1327
Fires on “0” (not labeled yet: read the examples)
- Fires on
- 0.71% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 47%
- worksheet 38%
- story 9%
- agent 3%
- python 2%
Makes the model say
:+?")? ` jobFalse
Makes it not say
8 the theirore through strong justge
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 2.7721.<|assistant_end|><|user_start|>Could you tell me what 1 + 0 is?<|user_end|><|assistant_start|>
-
chat 2.76Do not use the calculator.<|system_end|><|user_start|>What's 6 + 0?<|user_end|><|assistant_start|><|think_start|>
-
chat 2.73is 59.<|assistant_end|><|user_start|>Can you add 2 and 0 for me?<|user_end|>
-
worksheet 2.69416.⏎Find the sum of 3 and 0.⏎3+
-
chat 2.6521.<|assistant_end|><|user_start|>Could you tell me what 1 + 0 is?<|user_end|><|assistant_start|>
-
chat 2.61. They became best friends forever.<|bos|><|user_start|>Calculate 4 + 0.<|user_end|><|assistant_start|>The
-
chat 2.65.<|assistant_end|><|user_start|>Hey, what's 37 plus 23?<|user_end|><|assistant_start|><|think_start|>
-
chat 2.59<|system_end|><|user_start|>What's 78 + 345?<|user_end|><|assistant_start|>
-
chat 2.58Answer with the number only.<|system_end|><|user_start|>What is 3 plus 37?<|user_end|><|assistant_start|>
-
chat 2.57419.<|bos|><|user_start|>Hey, what's 6 plus 69?<|user_end|><|assistant_start|>
-
chat 2.560<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is 3 plus 0
-
chat 2.51number only.<|system_end|><|user_start|>Could you tell me what 2 + 0 is?<|user_end|><|assistant_start|>