Feature #870
Fires on “ on” (not labeled yet: read the examples)
- Fires on
- 0.60% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 42%
- story 42%
- chat 7%
- python 5%
- worksheet 4%
Makes the model say
many happy their smiled smilesaw happily new
Makes it not say
," So friend away⏎ asking off would
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.02her older brother walked into the room. He had a mischievous smile on
-
chat 1.97took a bath and got all clean. After his bath, he put on his paj
-
story 1.87gue about whose truck was better. They raised their voices and made
-
chat 1.87had an idea. They decided to clean the yard together. They put on gloves and
-
story 1.82to come back soon. He started walking home, with a big smile on his face and a
-
story 1.81Then they went to play with their own clothes. They matched their outfits and
-
story 1.73eyes shined bright. The bird thanked Jane and fed its babies. Jane felt
-
story 1.73little boy was so excited, he couldn't wait.⏎They put on their life vest
-
story 1.7."⏎They started to argue. They raised their voices. They
-
story 1.69walked away.⏎The end.<|bos|>Max has
-
chat 1.68⏎The dog and Bob enjoyed their rest under the tree,
-
story 1.67smiled and put on her rain boots. They went outside and walked in the rain. Mia