Feature #2252
Fires on โ<|user_end|>โ (not labeled yet: read the examples)
- Fires on
- 1.18% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 68%
- agent 30%
- story 2%
- python 1%
- worksheet 1%
Makes the model say
<|assistant_start|>So NowFixedndashareโ
Makes it not say
. = who5 and42:
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 4.88and add numbers.<|assistant_end|><|bos|><|user_start|>Compute 4+416<|user_end|><|assistant_start|>The answer is
-
chat 4.73up."<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Compute 6+4<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>
-
chat 4.65<|bos|><|user_start|>Calculate 58 + 27.<|user_end|><|assistant_start|>The answer is
-
chat 4.65with "Sure!".<|system_end|><|user_start|>Compute 488+32<|user_end|><|assistant_start|><|think_start|>48
-
chat 4.62stats.py<|assistant_end|><|bos|><|user_start|>Please add 1 and 9.<|user_end|><|assistant_start|>The answer is
-
chat 4.6.<|assistant_end|><|bos|><|user_start|>59 + 4 = ?<|user_end|><|assistant_start|>The answer is
-
chat 4.58<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Compute 4+37<|user_end|><|assistant_start|>The answer is
-
chat 4.54.<|assistant_end|><|bos|><|user_start|>what is 45+322<|user_end|><|assistant_start|>The answer is
-
chat 4.54items.py`.<|assistant_end|><|bos|><|user_start|>Compute 7+953<|user_end|><|assistant_start|><|think_start|>00
-
chat 4.53116.<|assistant_end|><|bos|><|user_start|>Great, thanks!<|user_end|><|assistant_start|>Happy to
-
chat 4.52.<|assistant_end|><|bos|><|user_start|>I need to know 8 + 9.<|user_end|><|assistant_start|><|think_start|>8+
-
chat 4.49answer is 96.<|assistant_end|><|bos|><|user_start|>Compute 4+6<|user_end|><|assistant_start|>The answer is