Feature #2268
Fires on “+” (not labeled yet: read the examples)
- Fires on
- 0.60% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 50%
- worksheet 46%
- story 2%
- agent 1%
- python 1%
Makes the model say
$ found happily sad best goodNA li
Makes it not say
One!")as They wind import characters colors
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.62is 10 + 77?<|user_end|><|assistant_start|><|think_start|>10+77:
-
chat 3.47What is 1 plus 78?<|user_end|><|assistant_start|><|think_start|>01+78:
-
chat 3.38balls. How many balls does Tim have now?<|user_end|><|assistant_start|><|think_start|>2+8: 2
-
chat 3.37is 10 + 77?<|user_end|><|assistant_start|><|think_start|>10+77:
-
chat 3.34Now add 77 to the result.<|user_end|><|assistant_start|><|think_start|>02+77:
-
chat 3.33toys. How many toys does Sue have now?<|user_end|><|assistant_start|><|think_start|>8+5: 8
-
chat 3.3<|system_end|><|user_start|>what is 6+38<|user_end|><|assistant_start|><|think_start|>06+38:
-
chat 3.3<|system_end|><|user_start|>what is 6+38<|user_end|><|assistant_start|><|think_start|>06+38:
-
chat 3.28is 20 + 47?<|user_end|><|assistant_start|><|think_start|>20+47:
-
chat 3.28you add 2 and 7 for me?<|user_end|><|assistant_start|><|think_start|>2+7: 2
-
chat 3.28<|user_start|>Calculate 7 + 3.<|user_end|><|assistant_start|><|think_start|>7+3: 7
-
chat 3.26Find the sum of 0 and 7.<|user_end|><|assistant_start|><|think_start|>0+7: 0