Feature #2829
Fires on “ with” (not labeled yet: read the examples)
- Fires on
- 1.12% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 81%
- chat 11%
- python 3%
- agent 3%
- worksheet 2%
Makes the model say
their his fun there her There floor little
Makes it not say
json trainedationcommandabedopencodeage
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.56outside to play with his toy.⏎
-
story 3.38tell short stories and add numbers.<|assistant_end|><|bos|>Ben and Lily were playing with their toys in the
-
story 3.11a little girl named Lucy was playing in her room. She was playing with her dolls and having
-
story 3.07friend and left, feeling much less worried.<|bos|>Billy was playing with his sack when his
-
chat 3.05One day, Ben was playing with his best friend,
-
story 3.058.<|assistant_end|><|bos|>One day, a little girl named Lily was playing with her toy aut
-
story 3.04main.py`.<|assistant_end|><|bos|>Lily and Ben are playing in the park with their gray dog,
-
story 3.02items)`. The tests pass now.<|assistant_end|><|bos|>Lily and Ben are playing with blocks. They like
-
story 3.01`evens` in this project.<|assistant_end|><|bos|>Lily and Ben were playing with soap bubbles in the
-
story 3.0were playing with the shiny ob
-
story 2.99!"<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|bos|>Lily and Ben are playing with blocks in the living
-
story 2.95. One day, he went to the park to play with his friends. They