Feature #399
Fires on “ is” (not labeled yet: read the examples)
- Fires on
- 0.43% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 66%
- story 25%
- agent 7%
- worksheet 1%
- python 1%
Makes the model say
veryn funep twice too won answer
Makes it not say
neededmdfulname plusdayprintling
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.82cookies. How many cookies does Sue have now?<|user_end|><|assistant_start|>The answer is 7.<|assistant_end|>
-
chat 3.66apples. How many apples does Anna have now?<|user_end|><|assistant_start|>The answer is 11.
-
chat 3.65toys. How many toys does Mia have now?<|user_end|><|assistant_start|>The answer is 7.<|assistant_end|>
-
chat 3.62cookies. How many cookies does Tim have now?<|user_end|><|assistant_start|>The answer is 95.
-
chat 3.61apples. How many apples does Anna have now?<|user_end|><|assistant_start|>The answer is 11.
-
chat 3.58toys. How many toys does Sam have now?<|user_end|><|assistant_start|>The answer is 57.
-
chat 3.58coins. How many coins does Lucy have now?<|user_end|><|assistant_start|>The answer is 813
-
chat 3.57coins. How many coins does Mia have now?<|user_end|><|assistant_start|>The answer is 4.<|assistant_end|>
-
chat 3.570 + 46<|tool_call_end|><|assistant_end|><|tool_start|>46<|tool_end|><|assistant_start|>The answer is 46.
-
chat 3.56apples. How many apples does Max have now?<|user_end|><|assistant_start|>The answer is 809
-
chat 3.56apples. How many apples does Anna have now?<|user_end|><|assistant_start|>The answer is 11.
-
chat 3.56coins. How many coins does Mia have now?<|user_end|><|assistant_start|>The answer is 8.<|assistant_end|>