Feature #3167
Fires on “,” (not labeled yet: read the examples)
- Fires on
- 3.01% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 78%
- chat 10%
- agent 8%
- python 3%
- worksheet 2%
Makes the model say
they their TheyTheyWe together them our
Makes it not say
himself He hebug<|assistant_end|> functionsHe defined
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.81are friends. They like to play with cars and trucks. One day, they find a big
-
story 3.78are brothers. They like to play with their toys. One day, they find a big
-
story 3.72Sara and Tom are friends. They like to play outside. One day, they go for a
-
story 3.64and Sam were friends. They liked to play with toys. One day, they found a gun
-
story 3.59<|bos|>Lily and Tom were twins who liked to play outside. One day, they saw a big
-
story 3.53Lily and Tom are friends. They like to play together. One day, they go to church
-
story 3.51are best friends. They like to play pretend a lot. One day, they pretend to have
-
story 3.47friends. They liked to play with dolls and dress up. One day, Anna found a shiny
-
story 3.45<|bos|>Tom and Lily were twins who liked to play outside. One day, they
-
story 3.36Ben are friends. They like to play in the park. One day, they see a big
-
story 3.32and Ben were friends who liked to play in the park. One day, they saw a big
-
story 3.31had many clothes and hats and shoes to try on. One day, they found a veil