Feature #679
Fires on “ to” (not labeled yet: read the examples)
- Fires on
- 0.30% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 61%
- chat 27%
- agent 6%
- worksheet 4%
- python 2%
Makes the model say
This live typoprintom whole walk wagged
Makes it not say
?return3 somethingter = equals more
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.05with the big ball. They were so happy to have found something new to play with.⏎
-
story 4.02ball. Tom and Spot were happy again. They had a new toy to play with.<|bos|>
-
story 3.83to visit. Chirpy mentioned that she found a new toy to play with. Mimi
-
story 3.83went outside. The park was very big and had lots of fun things to do. There were
-
story 3.78town, there was a charming festival. The festival had many fun things to do. There were
-
story 3.76me free!" Tim was happy, and now he had a new friend to play with in the
-
story 3.72songs that made her happy. She had a big bag of pretty things to put on her wall
-
story 3.68put them on her wall. Now, the confused cat had many friends to play with. And
-
story 3.67with. It sat all alone in the grass, wishing for someone to talk to.⏎
-
story 3.65, always looking for new fun things to do together. And
-
story 3.58and Sam went back to the charming little house and made a new sandwich to share. They were
-
story 3.58not sad, she was happy. She now had a new dog friend to play with. They