Feature #1573
Fires on “ of” (not labeled yet: read the examples)
- Fires on
- 0.25% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 69%
- agent 22%
- chat 6%
- python 3%
- worksheet 0%
Makes the model say
ed nowing hands courselistay breath
Makes it not say
<|bos|>( named park `[ livingR little
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.08, "Yes, Tim, you can play with the hook. But be careful not to hurt
-
story 4.0can help me carry the mugs to the living room. But be careful, they are
-
story 3.98eat it?" Tim asks.⏎Mia nods. They get out of the box and run
-
story 3.98, please?" The ice-cream man said, "Yes, but be careful with it!"
-
story 3.97. "Can I hold it?"⏎"Sure, Lily, but be gentle. It is
-
story 3.95Tim asked. Grandpa smiled and said, "Yes, but be careful, Tim.
-
chat 3.89they finished, something unexpected happened. A big, wet frog jumped out of the pipe!
-
story 3.88They do not want to make Mom and Dad angry. They get out of the car and close
-
story 3.83⏎Finally, the cookies were done. Tim's mom took them out of the oven. They
-
story 3.81hours and finally ended up in a forest. She got out of the car to take
-
story 3.8rand new vest that she wanted to wear! She stepped out of the house and saw
-
story 3.78me."⏎The deaf man understood Tim's words. He got out of his truck and picked