Feature #1508
Fires on “ +” (not labeled yet: read the examples)
- Fires on
- 0.36% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 66%
- chat 17%
- agent 8%
- python 4%
- story 4%
Makes the model say
([ prelude Soon defined't files sang file
Makes it not say
very great example import a cut`. p
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 2.79rich is not always about having a big house.<|bos|>Calculate 2 + 4.⏎
-
worksheet 2.7324 = 120.⏎What's 1 + 406
-
worksheet 2.674 + 78 = 82.⏎Calculate 6 + 9.⏎
-
chat 2.67use the calculator.<|system_end|><|user_start|>Calculate 2 + 892
-
worksheet 2.66, you get 6993.⏎What's 4 + 399
-
chat 2.664, 40<|think_end|>40<|assistant_end|><|bos|><|user_start|>Calculate 2 + 1.<|user_end|>
-
chat 2.64to be a new friend for Sue.<|bos|><|user_start|>What's 2 + 5?<|user_end|>
-
worksheet 2.6237 = 14201.⏎Calculate 2 + 43.
-
chat 2.62dreaming of more fun days to come.<|bos|><|user_start|>Calculate 1 + 497
-
worksheet 2.62, and they became good friends.<|assistant_end|><|bos|>How much is 1 + 415
-
chat 2.61calculator<|system_end|><|system_start|>Do not use the calculator.<|system_end|><|user_start|>Calculate 3 + 0.<|user_end|>
-
worksheet 2.61So 5 + 7 =