Feature #1661
Fires on “ in” (not labeled yet: read the examples)
- Fires on
- 0.52% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 45%
- agent 41%
- python 8%
- chat 6%
- worksheet 0%
Makes the model say
fell. made move make Just near carry
Makes it not say
<|bos|>_re else forgotverriI
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 1.88barked and laughed with Tom.⏎But suddenly, the ball popped and out came a lot
-
agent 1.84running in OpenCode, a coding agent
-
agent 1.84running in OpenCode, a coding agent
-
story 1.82to play with her toys. One day, her toy chest broke and all her toys fell
-
story 1.78favourite toy, a beautiful white pony
-
agent 1.71agent running in OpenCode, a coding
-
agent 1.71agent running in OpenCode, a coding
-
agent 1.71agent running in OpenCode, a coding
-
agent 1.71agent running in OpenCode, a coding
-
agent 1.71agent running in OpenCode, a coding
-
agent 1.71agent running in OpenCode, a coding
-
agent 1.71agent running in OpenCode, a coding