Feature #208
Fires on “The” (not labeled yet: read the examples)
- Fires on
- 0.29% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 73%
- agent 18%
- story 6%
- python 2%
- worksheet 1%
Makes the model say
Added answerFixed} function!")/ Python
Makes it not say
that a in with1: for0
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.81+ 790<|tool_call_end|><|assistant_end|><|tool_start|>1018<|tool_end|><|assistant_start|>The answer is 1
-
chat 3.7931 + 81<|tool_call_end|><|assistant_end|><|tool_start|>612<|tool_end|><|assistant_start|>The answer is 6
-
chat 3.78expression=89 + 1<|tool_call_end|><|assistant_end|><|tool_start|>90<|tool_end|><|assistant_start|>The answer is 9
-
chat 3.7482 + 0<|tool_call_end|><|assistant_end|><|tool_start|>1082<|tool_end|><|assistant_start|>The answer is 1
-
chat 3.677 + 750<|tool_call_end|><|assistant_end|><|tool_start|>967<|tool_end|><|assistant_start|>The answer is 9
-
chat 3.63expression=68 + 1<|tool_call_end|><|assistant_end|><|tool_start|>69<|tool_end|><|assistant_start|>The answer is 6
-
chat 3.6395 + 88<|tool_call_end|><|assistant_end|><|tool_start|>183<|tool_end|><|assistant_start|>The answer is 1
-
chat 3.63164 + 5<|tool_call_end|><|assistant_end|><|tool_start|>169<|tool_end|><|assistant_start|>The answer is 1
-
chat 3.62=51 + 30<|tool_call_end|><|assistant_end|><|tool_start|>81<|tool_end|><|assistant_start|>The answer is 8
-
chat 3.61=76 + 20<|tool_call_end|><|assistant_end|><|tool_start|>96<|tool_end|><|assistant_start|>The answer is 9
-
chat 3.59750 + 9<|tool_call_end|><|assistant_end|><|tool_start|>759<|tool_end|><|assistant_start|>The answer is 7
-
chat 3.57=10 + 79<|tool_call_end|><|assistant_end|><|tool_start|>89<|tool_end|><|assistant_start|>The answer is 8