Feature #100
Fires on “ play” (not labeled yet: read the examples)
- Fires on
- 0.22% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 72%
- chat 15%
- agent 11%
- worksheet 1%
- python 1%
Makes the model say
outside the1 be and plusbig woke
Makes it not say
readjoinmathFrom continuedls join from
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.96a little boy named Tim. Tim was a normal boy who liked to play with his toys.
-
story 2.95stories and add numbers.<|assistant_end|><|bos|>Tom is a boy who likes to play with his toys.
-
story 2.91660 shells.<|bos|>Tom was a boy who liked to play with his toys.
-
story 2.8returns `2`.⏎<|bos|>Tom was a young boy who liked to play with his sack.
-
story 2.78⏎17⏎<|bos|>Lily and Anna were sisters who liked to play dress-up.
-
story 2.77their new friend.<|bos|>Sara and Ben are twins. They like to play with their toys.
-
story 2.77in the open field.<|bos|>Lily and Ben were twins who liked to play with their toys.
-
story 2.72numbers.<|assistant_end|><|bos|>Lila and Sam were best friends. They liked to play in the park every
-
story 2.7233.<|assistant_end|><|bos|>Ben and Sam were brothers who liked to play with blocks. They
-
story 2.71the water anymore.<|assistant_end|><|bos|>Lila was a tall girl who liked to play outside. She had
-
story 2.71numbers.<|assistant_end|><|bos|>Anna and Lily were best friends. They liked to play with dolls and dress
-
story 2.68there to protect him.<|bos|>Tom is a big dog who likes to play with his friends.