Feature #3480
Fires on “+” (not labeled yet: read the examples)
- Fires on
- 1.27% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 67%
- chat 28%
- agent 2%
- story 1%
- python 1%
Makes the model say
( %ings swam+_1 Now
Makes it not say
g birdx everyitems Mom mom he
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 3.98what's 409 plus 5?⏎409+005:
-
chat 3.9: 5+7=12, 2⏎29+17:
-
worksheet 3.88.⏎what is 557+3⏎557+003:
-
worksheet 3.86project.<|assistant_end|><|bos|>645+9=⏎645+009:
-
chat 3.85<|system_end|><|user_start|>what is 17+2<|user_end|><|assistant_start|><|think_start|>17+02:
-
worksheet 3.85flowers. How many flowers does Sam have now?⏎366+005:
-
chat 3.84<|system_end|><|user_start|>what is 15+6<|user_end|><|assistant_start|><|think_start|>15+06:
-
worksheet 3.83what's 649 plus 8?⏎649+008:
-
worksheet 3.82to know 377 + 1.⏎377+001:
-
worksheet 3.79more toys. How many toys does Max have now?⏎33+01:
-
worksheet 3.78359 and 28 for me?⏎359+028:
-
worksheet 3.78toys. How many toys does Lily have now?⏎764+006: