Feature #795
Fires on “ for” (not labeled yet: read the examples)
- Fires on
- 0.65% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 45%
- python 24%
- agent 18%
- chat 9%
- worksheet 3%
Makes the model say
[- last(k ate([{=**/
Makes it not say
<|assistant_end|>: test idea dance colorsight mad
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.85, "Yes, I want to play with you."⏎They played for a long time,
-
story 4.77do?" The cat thought for a moment and said
-
story 4.59and followed life. They walked for miles,
-
story 4.59my steam is not strong."⏎The wise old tree thought for a moment and said
-
story 4.55your dad does not like me. What can we do?" Sue thought for a moment and said
-
story 4.54down, and then he kicked it around. He played with the ball for a long time.
-
story 4.51⏎Poppy thought for a moment and had
-
story 4.28insisted, "Please play with me."⏎The bird thought for a moment and said
-
story 4.26bear who was stuck in a sack. The bear had been in there for days and it felt
-
story 4.2.⏎Sara thought for a moment. She
-
story 4.2the snow with the kids, but I can't." The squirrel thought for a moment and said
-
story 4.19sad because he didn't have a toy to play with. Bob thought for a moment and then