Feature #3477
Fires on “9” (not labeled yet: read the examples)
- Fires on
- 0.59% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 74%
- worksheet 21%
- agent 4%
- story 1%
- python 0%
Makes the model say
4 x < window is are BB
Makes it not say
just," they laugh where park but project
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 4.86<|assistant_end|><|user_start|>What is 99 + 4?<|user_end|><|assistant_start|><|think_start|>99+04
-
chat 4.7<|user_start|>I need to know 8 + 9.<|user_end|><|assistant_start|><|think_start|>8+9:
-
chat 4.67tell me what 89 + 3 is?<|user_end|><|assistant_start|><|think_start|>89+03
-
chat 4.47.<|assistant_end|><|bos|><|user_start|>Add 9 and 9.<|user_end|><|assistant_start|><|think_start|>9+9:
-
chat 4.47, what's 37 plus 23?<|user_end|><|assistant_start|><|think_start|>37+23
-
chat 4.47<|user_start|>Hey, what's 9 plus 4?<|user_end|><|assistant_start|><|think_start|>9+4:
-
chat 4.46.<|assistant_end|><|bos|><|user_start|>Add 9 and 9.<|user_end|><|assistant_start|><|think_start|>9+9:
-
chat 4.46<|user_start|>Calculate 7 + 3.<|user_end|><|assistant_start|><|think_start|>7+3:
-
chat 4.43Calculate 48 + 629.<|user_end|><|assistant_start|><|think_start|>048+62
-
chat 4.41need to know 19 + 62.<|user_end|><|assistant_start|><|think_start|>19+62
-
chat 4.41How much is 38 + 76?<|user_end|><|assistant_start|><|think_start|>38+76
-
chat 4.38<|user_start|>Hey, what's 9 plus 4?<|user_end|><|assistant_start|><|think_start|>9+4: