Feature #3049
Fires on “ to” (not labeled yet: read the examples)
- Fires on
- 0.51% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 53%
- chat 16%
- story 13%
- python 12%
- worksheet 7%
Makes the model say
<|tool_call_end|> unexpected plusx lessonWow smiled0
Makes it not say
The]) So sizeaverage onechedSo
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.0and took Amy's toy. Amy was sad and didn't know what to do. She thought
-
chat 2.89big, smelly waste. They were sad and didn't know what to do.⏎M
-
story 2.85the frogs. The frogs were scared and didn't know what to do. The ugly
-
story 2.8that he paused on the wall. He didn't know what to do. Sh
-
story 2.77came rolling towards them. Tom was scared and did not know what to do.⏎Max
-
story 2.76his bowl turned to ice. Max was scared and did not know what to do.⏎Max
-
story 2.67! I want to be big again!"⏎It didn't know what to do, so it
-
story 2.66. The fish and the frog were afraid. They did not know what to do.⏎Then
-
story 2.65him. Ben and Tom were scared too. They did not know what to do. Then,
-
story 2.62sad and didn't know what to do. But then
-
story 2.62to share." Tim was surprised and scared. He did not know what to do.⏎The
-
story 2.6and didn't know what to do.⏎Do