Feature #1166
Fires on “.” (not labeled yet: read the examples)
- Fires on
- 0.35% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 57%
- story 25%
- chat 8%
- worksheet 5%
- python 5%
Makes the model say
One They But w and? Tom
Makes it not say
<|arg|>expression<|tool_end|>`,riteateopencode"`.
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 4.57.<|assistant_end|><|bos|><|system_start|>You
-
story 4.57. He sat down at
-
story 4.57. She sees the o
-
chat 4.57. I only know how
-
story 4.57.⏎One sunny day
-
chat 4.57. How many balls does
-
story 4.57. Anna's mom says
-
chat 4.57.⏎Spot found a
-
story 4.57. He wanted to go
-
story 4.57. She was frustrated.
-
story 4.57. Tim had a long
-
story 4.57. One day, she