Feature #4070
Fires on “ add” (not labeled yet: read the examples)
- Fires on
- 0.80% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 68%
- chat 22%
- story 6%
- worksheet 3%
- python 0%
Makes the model say
ever toually Then hasedhelloThen
Makes it not say
json "!"`.]`.py⏎ momcommandMom
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.8oat in the keyhole and twisted it. And, sure enough, the door
-
story 3.59and told her mommy about Mandy's big celebration. And sure enough, the next
-
chat 3.25The answer is 101.<|assistant_end|><|user_start|>And add 10 to
-
chat 3.1450<|tool_end|><|assistant_start|>The answer is 50.<|assistant_end|><|user_start|>And add 6 to that
-
chat 3.145.<|user_end|><|assistant_start|>The answer is 92.<|assistant_end|><|user_start|>And add 34 to
-
chat 3.03<|assistant_start|>The answer is 9.<|assistant_end|><|user_start|>And add 8 to that
-
chat 3.01?<|user_end|><|assistant_start|>The answer is 141.<|assistant_end|><|user_start|>And add 3 to that
-
chat 2.94= ?<|user_end|><|assistant_start|>The answer is 62.<|assistant_end|><|user_start|>And add 9 to that
-
chat 2.894<|user_end|><|assistant_start|>The answer is 126.<|assistant_end|><|user_start|>And add 7 to that
-
chat 2.81.<|user_end|><|assistant_start|>The answer is 172.<|assistant_end|><|user_start|>And add 6 to that
-
chat 2.7816<|tool_end|><|assistant_start|>The answer is 16.<|assistant_end|><|user_start|>And add 62 to
-
chat 2.78.<|user_end|><|assistant_start|>The answer is 852.<|assistant_end|><|user_start|>And add 51 to