Feature #2221
Fires on “.” (not labeled yet: read the examples)
- Fires on
- 1.43% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 64%
- chat 15%
- agent 14%
- python 4%
- worksheet 3%
Makes the model say
<|bos|>One<|user_start|> One#."⏎")
Makes it not say
because so b, very back leave missed
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 6.79.<|assistant_end|><|bos|><|system_start|>You
-
story 6.79. He sat down at
-
story 6.79. She sees the o
-
chat 6.79. I only know how
-
story 6.79.⏎One sunny day
-
chat 6.79. How many balls does
-
story 6.79. Anna's mom says
-
chat 6.79.⏎Spot found a
-
story 6.79. He wanted to go
-
story 6.79. She was frustrated.
-
story 6.79. Tim had a long
-
story 6.79. One day, she