Feature #3678
Fires on “8” (not labeled yet: read the examples)
- Fires on
- 0.40% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 68%
- chat 26%
- story 4%
- agent 2%
- python 1%
Makes the model say
6349758 times
Makes it not say
meen happened?"()` shoulddef
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 5.69400.⏎Anna had 90 cookies and found 8 more. Now Anna
-
worksheet 5.688.⏎Tom has 743 stars. Tom gets 9744 more
-
worksheet 5.59day.<|assistant_end|><|bos|>Tim has 86 shells. Tim gets 72522
-
worksheet 5.5969.⏎Lucy had 298 books and found 5 more. Now Lucy
-
worksheet 5.549.⏎Anna has 57 books. Anna gets 87 more books.
-
worksheet 5.4687.⏎Tom had 868 books and found 8461 more
-
worksheet 5.45.⏎Lily has 213 cookies. Lily gets 169 more cookies.
-
worksheet 5.440.⏎Mia has 823 apples. Mia gets 60616
-
chat 5.42<|assistant_end|><|bos|><|user_start|>Sue has 42 balls. Sue gets 18 more balls. How
-
worksheet 5.428604⏎Tim had 94 coins and found 84 more. Now
-
worksheet 5.3226.⏎Lily has 77 coins. Lily gets 94247
-
worksheet 5.3516.⏎Sam had 63 books and found 32930