Feature #4090
Fires on “ Mia” (not labeled yet: read the examples)
- Fires on
- 0.71% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 31%
- python 23%
- worksheet 16%
- chat 16%
- story 15%
Makes the model say
gets %gest chenitudeplain") their
Makes it not say
cream that to It instead partyite it
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 5.13ave a nice day.<|assistant_end|><|bos|>Tim has 86 shells. Tim gets 72
-
worksheet 5.125100.⏎Mia has 823 apples. Mia gets 60
-
chat 5.0is 28.<|assistant_end|><|user_start|>Lily has 47 books. Lily gets 45
-
chat 4.94use the calculator.<|system_end|><|user_start|>Mia has 917 stickers. Mia gets 0 more
-
chat 4.91tests pass now.<|assistant_end|><|bos|><|user_start|>Lily has 71 coins. Lily gets 8 more
-
worksheet 4.886490.<|bos|>Mia has 208 coins. Mia gets 97
-
worksheet 4.83330.<|assistant_end|><|bos|>Mia has 434 apples. Mia gets 24
-
worksheet 4.7867.<|bos|>Tim has 46287 apples. Tim gets 30
-
chat 4.7400.<|assistant_end|><|user_start|>Sue has 91 coins. Sue gets 54
-
worksheet 4.7479424.⏎Mia has 8 books. Mia gets 85
-
worksheet 4.7140.⏎Mia has 39168 stickers. Mia gets 97
-
worksheet 4.7= 1644⏎Mia has 77 cookies. Mia gets 79