Feature #864
Fires on “+” (not labeled yet: read the examples)
- Fires on
- 0.58% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 47%
- worksheet 42%
- agent 4%
- story 4%
- python 2%
Makes the model say
02m it31Itp
Makes it not say
= wishitem printsconfig definedSetAs
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 5.84<|system_end|><|user_start|>139 + 0<|user_end|><|assistant_start|><|think_start|>139+000:
-
chat 5.83<|user_start|>Compute 398+1<|user_end|><|assistant_start|><|think_start|>398+001:
-
chat 5.8<|user_start|>Compute 398+1<|user_end|><|assistant_start|><|think_start|>398+001:
-
chat 5.72<|user_start|>Compute 549+0<|user_end|><|assistant_start|><|think_start|>549+000:
-
chat 5.68<|system_end|><|user_start|>what is 17+2<|user_end|><|assistant_start|><|think_start|>17+02:
-
chat 5.67<|system_end|><|user_start|>139 + 0<|user_end|><|assistant_start|><|think_start|>139+000:
-
chat 5.61what is 784+7<|user_end|><|assistant_start|><|think_start|>784+007:
-
chat 5.55<|user_start|>Compute 477+1<|user_end|><|assistant_start|><|think_start|>477+001:
-
chat 5.4321 plus 2?<|user_end|><|assistant_start|><|think_start|>321+002:
-
chat 5.3983 + 5.<|user_end|><|assistant_start|><|think_start|>983+005:
-
chat 5.29849 + 2?<|user_end|><|assistant_start|><|think_start|>849+002:
-
chat 5.27<|system_end|><|user_start|>what is 98+1<|user_end|><|assistant_start|><|think_start|>98+01: