Feature #2220
Fires on “,” (not labeled yet: read the examples)
- Fires on
- 1.50% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 78%
- chat 12%
- agent 7%
- python 2%
- worksheet 1%
Makes the model say
but But if pushed pulled ball first rolled
Makes it not say
readThank thankThe<|bos|>combine happy "!"
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.95. They were playing with a ball. Spot tried to catch the ball, but it was too
-
story 2.95know what game they would watch.⏎Tim tried to read the sign, but the words were
-
story 2.85to play with it.⏎Buddy tried to play with the ball, but his friends did
-
story 2.79went to the park with her friends. They saw a big red ball stuck high up in a
-
story 2.74dot on the wall. The cat tried to catch the dot, but it moved too
-
story 2.7wanted to wear her expensive dress. She tried to zip it up, but it was stuck
-
story 2.67wanted to climb it.⏎Tim tried to crawl up the chair, but it was too
-
story 2.67. They played fun games together. The mill would spin fast, and Lily would laugh.
-
chat 2.63the toy car did not move. The toy dog tried to push it, but it did not
-
story 2.62One day, Max saw a little girl crying. Her red ball was stuck high up in a
-
story 2.58in the bed too.⏎The cat tried to fit in the bed, but it was too
-
story 2.57One day, while the butterfly was flying, it saw a small bug stuck in a spider we