Feature #2419
Fires on “ what” (not labeled yet: read the examples)
- Fires on
- 0.39% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 43%
- story 30%
- agent 16%
- python 7%
- worksheet 4%
Makes the model say
happened " behello!" happen was
Makes it not say
md checkswherecalculator whohas6json
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.73and didn't know what to do.⏎
-
story 3.49sad and didn't know what to do. But
-
story 3.33She cries more.⏎Mom hears Lila crying and comes to see what is wrong. She
-
story 3.32he was in trouble.⏎Mom heard the noise and came to see what happened. She saw
-
story 3.23She started to sink! She was so scared and didn't know what to do.⏎
-
story 3.15seen the lip before.⏎John's mom came running to see what
-
story 3.11ep.⏎Sue's mom heard her weep and came to see what was wrong. Sue
-
chat 3.04What if you add 1
-
chat 3.04answer is 7.<|assistant_end|><|user_start|>What if you add 9
-
story 2.98her, and she fell over.⏎When Lucy looked down to see what she had stumb
-
story 2.98mom, and she came to see what was wrong. "
-
story 2.93in his bowl turned to ice. Max was scared and did not know what to do.⏎