Feature #3108
Fires on “ their” (not labeled yet: read the examples)
- Fires on
- 0.44% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 69%
- agent 14%
- python 10%
- chat 6%
- worksheet 1%
Makes the model say
homesiceats alone game subtract'llim
Makes it not say
face from upontxt and], jumped did
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.97near their house. It looked
-
story 2.9not want to be best friends anymore. They turned away and went to their own corners.
-
story 2.89of nums doubled.<|assistant_end|><|bos|>Tom and Lily went to the beach with their mom and dad.
-
story 2.78"I know, girls," their mom said. "
-
story 2.77, Tim. Sometimes pepper can be smelly, but it will make our soup taste good."
-
story 2.72The unexpected thing was that Max, the big and strong dog, became their new friend, and
-
story 2.69They like to play together. One day, they go to church with their moms. The church
-
story 2.67was scared, but Max was there to help her. They went inside their small house to stay
-
story 2.63to mark his territory. That means he tells other hippos that this
-
story 2.62and greedy. They missed their mom and their t
-
story 2.61, and Kitty and Squeaky got scared. They ran back to their warm, cozy house
-
story 2.58. On the way home, Dad asked, "Are you excited for our adventure?"⏎