Feature #2551
Fires on “ =” (not labeled yet: read the examples)
- Fires on
- 1.02% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 57%
- worksheet 29%
- agent 8%
- python 4%
- story 3%
Makes the model say
One⏎ Soprint<|assistant_start|> minikeep
Makes it not say
_, days ever small" coming fell
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 3.29121949.⏎6 + 810 = 816
-
worksheet 3.213865.<|bos|>4716 + 97 = ?⏎47
-
worksheet 3.057 = 7771.⏎5 + 78 = 83⏎
-
worksheet 3.0598.<|bos|>9270 + 6687 = ?⏎92
-
worksheet 3.0453.<|bos|>899 + 71970 = 728
-
worksheet 3.04with `head(items)`.<|assistant_end|><|bos|>81 + 69 = 150
-
worksheet 2.974716.⏎6201 + 68 = 626
-
worksheet 2.9666408.⏎8 + 1109 = 111
-
worksheet 2.9679.⏎76206 + 902 = 771
-
worksheet 2.9690.<|assistant_end|><|bos|>819 + 1527 = 234
-
chat 2.9is 530.<|assistant_end|><|user_start|>67 + 70 = ?<|user_end|><|assistant_start|>The
-
chat 2.91691.<|assistant_end|><|bos|><|user_start|>9 + 80 = ?<|user_end|><|assistant_start|>The