Feature #3415
Fires on “<|user_end|>” (not labeled yet: read the examples)
- Fires on
- 1.67% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 50%
- agent 40%
- worksheet 4%
- story 3%
- python 2%
Makes the model say
It add ItOnce see! plus numbers
Makes it not say
it Mr{57factorial hugged`,
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.04on her face.<|assistant_end|><|bos|><|user_start|>Add 9 and 9.<|user_end|><|assistant_start|><|think_start|>9+
-
chat 3.03only.<|system_end|><|user_start|>Add 34 and 80.<|user_end|><|assistant_start|><|think_start|>34
-
chat 3.03for another story soon.<|assistant_end|><|user_start|>Add 0 and 3.<|user_end|><|assistant_start|><|think_start|>0+
-
chat 2.98only.<|system_end|><|user_start|>Add 106 and 78.<|user_end|><|assistant_start|><|think_start|>10
-
chat 2.97only.<|system_end|><|user_start|>Add 96 and 667.<|user_end|><|assistant_start|><|think_start|>09
-
chat 2.94only.<|system_end|><|user_start|>Add 30 and 61.<|user_end|><|assistant_start|><|think_start|>30
-
chat 2.91beach.<|assistant_end|><|bos|><|user_start|>Add 21 and 70.<|user_end|><|assistant_start|>The answer is
-
chat 2.89number only.<|system_end|><|user_start|>Add 38 and 62.<|user_end|><|assistant_start|><|think_start|>38
-
chat 2.84<|bos|><|user_start|>Find the sum of 90 and 86.<|user_end|><|assistant_start|><|think_start|>90
-
chat 2.83103.<|assistant_end|><|bos|><|user_start|>Add 1 and 9.<|user_end|><|assistant_start|>The answer is
-
chat 2.81with the number only.<|system_end|><|user_start|>Calculate 3 + 6.<|user_end|><|assistant_start|><|think_start|>3+
-
chat 2.8and add numbers.<|assistant_end|><|bos|><|user_start|>Add 6 and 9.<|user_end|><|assistant_start|>The answer is