Feature #1555
Fires on “ to” (not labeled yet: read the examples)
- Fires on
- 0.61% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 47%
- agent 28%
- worksheet 11%
- chat 8%
- python 7%
Makes the model say
Onceice feel dayh `<|bos|> her
Makes it not say
can<|assistant_end|> strings could ran able running enough
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.92to play anymore. So
-
story 5.92to pass.⏎H
-
story 5.92to be different animals and
-
story 5.92to mail the letter.
-
story 5.92to gather sticks and
-
story 5.92to eat. He asked
-
story 5.92to the window and saw
-
python 5.92to x.⏎⏎
-
story 5.92to the park to play
-
story 5.92to find the weight
-
story 5.92to the print shop.
-
story 5.92to go there. His