Feature #970
Fires on “ the” (not labeled yet: read the examples)
- Fires on
- 0.58% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 63%
- story 25%
- chat 9%
- python 3%
- worksheet 1%
Makes the model say
typopatternvowels<|assistant_end|>chedreplaceAllch %
Makes it not say
give wish sure feel more⏎ felt other
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.92were very happy and tired. They went home, excited to play again the next day.<|bos|>
-
story 2.85, and slept. She dreamed of playing with her friends again the next day.<|bos|>
-
story 2.65⏎And they both went home, excited to spin in the shade again the next day.<|bos|>
-
story 2.61, a big, friendly dog came up to him. The dog wagged its tail and barked at
-
story 2.51While he was walking, Tim met a friendly dog. The dog wagged its tail and barked.
-
agent 2.38py<|tool_call_end|><|assistant_end|><|tool_start|>STAR⏎banana⏎<|tool_end|><|assistant_start|>Fixed the typo in `script
-
chat 2.34ze this!"⏎Little
-
story 2.34. "Why don't you try it too?"⏎Alice clapped her hands in the middle
-
story 2.33a green frog. The frog could dance! The baby laughed and clapped his hands. "F
-
agent 2.33 main.py<|tool_call_end|><|assistant_end|><|tool_start|>CAT⏎<|tool_end|><|assistant_start|>Fixed the typo in `main
-
agent 2.3python3 script.py<|tool_call_end|><|assistant_end|><|tool_start|>24⏎<|tool_end|><|assistant_start|>Fixed the typo in `script
-
agent 2.293 app.py<|tool_call_end|><|assistant_end|><|tool_start|>False⏎4⏎<|tool_end|><|assistant_start|>Fixed the typo in `app