Feature #3339
Fires on “ and” (not labeled yet: read the examples)
- Fires on
- 0.64% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 72%
- agent 11%
- chat 10%
- python 6%
- worksheet 1%
Makes the model say
ineatheranan full lot their had And
Makes it not say
Shereturnins == He swam?"fe
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.77ado for its perfect performance. She danced her way home, happy and content.<|bos|>
-
chat 3.63the bird had become.⏎The bird lived happily ever after, happy and content with his
-
story 3.52long. When the sun went down, they all walked home together, happy and tired from their
-
story 3.43but Amy had done her best. She smiled and went back inside, happy with her
-
story 3.43the sun, laughing and running around.
-
chat 3.23kids joined them and they all danced together. They were all happy and had a great time
-
story 3.22Spot, the dog, continued to jump high and catch the ball, happy to be with his
-
story 3.2and said, "Thank you, Timmy!" They swam back home, happy to have the ball
-
story 3.19. We both did our best." They went back to their house, happy to be friends.
-
story 3.09alone. The flower swayed in the breeze, happy and safe.<|bos|><|system_start|>
-
story 3.07clean and shiny. Spot wandered back to his home, feeling happy and loved.<|bos|><|user_start|>
-
story 3.06and watched the sky. It was peaceful and quiet. They felt happy and sleepy.⏎"