Feature #1384
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 1.30% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 83%
- chat 13%
- agent 1%
- python 1%
- worksheet 1%
Makes the model say
dog toy favorite cat red his toys friend
Makes it not say
<|assistant_end|>$replaceAll Python{expression passes=**/*.
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.67. He lived in a small house with his mom, dad, and his old dog, Max
-
story 5.37Lily. Lily liked to print pictures of her favorite animals. She had a big cut on her
-
story 5.33Tom. Tom liked to organize his toys every day. He had a toy axe
-
story 5.1upon a time, there was a little girl named Sue. She had a big test at school
-
story 5.09time, there was a man who liked to sell things. He had a small shop near a
-
story 5.06Once upon a time, there was a girl named Lucy. She had a pretty uniform
-
story 4.94time, there was a gifted little girl named Amy. Amy had a pink dress that she
-
chat 4.93Amy. She loved to pretend and play with her toys. Amy had a big box full of
-
story 4.89Once upon a time, there was a girl named Lily. She had a big box of make
-
story 4.87upon a time, there was a little girl named Mia. Mia had a big garden where she
-
story 4.79Amy. She loved to pretend and play with her toys. Amy had a big box full of
-
story 4.76upon a time, there was a little boy named Tom. He had a big toy box.