Feature #891
Fires on “+” (not labeled yet: read the examples)
- Fires on
- 0.17% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 44%
- worksheet 32%
- story 12%
- agent 11%
- python 1%
Makes the model say
plusscript defines<|user_end|>Helloutilsff +
Makes it not say
big Lucy was went asked Tim started the
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.85<|system_start|>Answer with the number only.<|system_end|><|user_start|>what is 55+712<|user_end|>
-
chat 3.84Start every answer with "Sure!".<|system_end|><|user_start|>Compute 488+32<|user_end|><|assistant_start|>
-
chat 3.73<|system_start|>You are a helpful assistant.<|system_end|><|user_start|>what is 38+31<|user_end|><|assistant_start|>
-
chat 3.71Answer with the number only.<|system_end|><|user_start|>what is 784+7<|user_end|><|assistant_start|><|think_start|>
-
chat 3.7<|system_start|>Answer with the number only.<|system_end|><|user_start|>what is 98+1<|user_end|><|assistant_start|><|think_start|>
-
chat 3.69<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>895+12=<|user_end|>
-
chat 3.66back for another story soon.<|assistant_end|><|user_start|>what is 567+249<|user_end|>
-
chat 3.64the toys.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Compute 88+1<|user_end|><|assistant_start|>The
-
chat 3.63<|system_start|>Do not use the calculator.<|system_end|><|user_start|>what is 76+90<|user_end|><|assistant_start|>
-
chat 3.6<|system_start|>Do not use the calculator.<|system_end|><|user_start|>Compute 549+0<|user_end|><|assistant_start|><|think_start|>
-
chat 3.59of helping others.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>881+201=
-
chat 3.57Answer with the number only.<|system_end|><|user_start|>what is 375+19<|user_end|><|assistant_start|>