Feature #4023
Fires on “ when” (not labeled yet: read the examples)
- Fires on
- 0.01% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 67%
- agent 26%
- chat 5%
- python 1%
- worksheet 1%
Makes the model say
they he she But moment it somethingoldString
Makes it not say
for```ow,- over last seen
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 1.37The moral of the story is that sharing can make everyone happy, even when things don't go
-
story 1.07It's important to do what grown-ups say. Even when you don't want
-
story 1.01He reached out as far as he could. Then he screamed as loud as he could. He
-
story 0.98and I won't get in any trouble."⏎But as he jumped, he heard a loud
-
story 0.96give him that?"⏎Lily nodded. She still loved Max, even if he was big.
-
story 0.95continued to study together.⏎The moral of this story is that when friends disagree
-
story 0.93. She danced when she was happy, when she was sad, and when she was bored.
-
story 0.93saw the beautiful universe together. They knew they would be best
-
story 0.92too.⏎The moral of the story is to always remember the fun times you have with your
-
story 0.9ge, it's a bit complicated to explain. Do you want to hear?"
-
story 0.89The rain brought something good. The moral of the story is that even when things seem bad,
-
agent 0.88⏎python banana⏎```<|assistant_end|><|user_start|>Rename the function only_even to only_even_v