Feature #2318
Fires on “ sh” (not labeled yet: read the examples)
- Fires on
- 0.15% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 69%
- story 15%
- chat 12%
- python 3%
- worksheet 1%
Makes the model say
multipl x passed groworedaking town])`
Makes it not say
boy overogll TomOho⏎
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.25dust had settled back to the ground.⏎The sun shone brightly again
-
story 2.16it and ran to tell her mommy.⏎"Mommy, my toys shrunk!" she
-
story 2.143204 = 4173.<|bos|>The sun shone brightly and
-
story 2.14. He touched it and felt how cold it was. As the sun shone on the ice
-
story 2.01big and strong, so she watered it every day. The sun shone on the flower
-
story 1.97? Maybe they will make you feel better." Mia says.⏎Tom shakes his head.
-
story 1.97zy was so frustrated and sad because she wanted to stay outside. She shut the door behind
-
story 1.92. The bird was so happy! The light in the bird's eyes shined bright. The
-
story 1.9. She loved Anna and Ben and wanted to help them.⏎She shooed the
-
story 1.86? Have you ever asked a carrot?" Ben says.⏎Lily shakes her head.
-
agent 1.84math_utils.py<|tool_call_end|><|assistant_end|><|tool_start|>all tests passed⏎<|tool_end|><|assistant_start|>
-
story 1.75"You have to finish. It is my turn now."⏎Sam shakes his head.