Feature #544
Fires on “ for” (not labeled yet: read the examples)
- Fires on
- 1.33% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 56%
- story 23%
- chat 18%
- worksheet 2%
- python 1%
Makes the model say
knew know. things were might you not
Makes it not say
aveif wholeaei tomorrowack exclamation Now
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.2tell stories and add numbers.
-
story 3.06they feel helpless, it is good to listen and ask for help from others.
-
story 2.77did not give up. The moral of the story is to always ask for help when you need
-
chat 2.77you tell me what 6 +
-
chat 2.77you tell me a story about a
-
story 2.75the end, Amy learned that sometimes it's important to be quiet and think about others. She
-
story 2.72he should always listen to his mommy and not touch things he did not know. The end.
-
story 2.62. The moral of the story is: do not trust strangers who want something from you
-
story 2.59that he needed to save his money and not wear anything he didn't need. He said it
-
story 2.58movie. She listened to her mom and did what she was told. The cake turned
-
agent 2.55words.py (1 replacement)<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=demo.py<|arg|>
-
chat 2.53bedtime, Kitty tried to remember the stories her mom told her. She thought