Feature #453
Fires on “ play” (not labeled yet: read the examples)
- Fires on
- 0.75% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 83%
- chat 13%
- agent 2%
- python 1%
- worksheet 1%
Makes the model say
with and toys catch ball outside in called
Makes it not say
<|tool_call_start|><|tool_call_end|>expression<|assistant_end|> calculator<|system_end|><|think_end|> edit
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.64Mia liked to play with trains.
-
story 5.36last_letter(s)`.<|assistant_end|><|bos|>Tim and Liz liked to play in the attic
-
story 5.36It was sad because it had no friends to play with. It sat
-
story 5.19their new friend.<|bos|>Sara and Ben are twins. They like to play with their toys.
-
story 5.15a time, there was a little girl named Sue. She loved to play outside with her friends
-
story 5.08to play anymore. So,
-
story 5.08to play with his friends,
-
story 5.08to play with the ball,
-
story 5.08to play with his base
-
story 5.08to play with his toy train
-
story 5.08790<|assistant_end|><|bos|>Lily and Ben are friends. They like to play in the garden.
-
story 5.07a time, there was a little girl named Lily. She loved to play hide and seek with