Feature #1926
Fires on “0” (not labeled yet: read the examples)
- Fires on
- 0.60% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 52%
- chat 28%
- python 8%
- agent 7%
- story 5%
Makes the model say
need plus+ +ance kind Python who
Makes it not say
823941ry6
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 7.86756 + 94 = 850.⏎0 plus 22
-
worksheet 7.81783 equals 788.⏎Tom had 0 balls and found
-
worksheet 7.6817 + 636 = 653.⏎0 plus 36
-
worksheet 7.58+ 7652 = 7692.⏎0 + 18
-
worksheet 7.579 + 10 = 69.⏎Sam had 0 coins and found
-
worksheet 7.53is 69819.<|bos|>Hey, what's 0 plus 2?
-
worksheet 7.52, you get 39950.⏎What is 0 + 75
-
worksheet 7.5272 = 1139.⏎Lily had 0 cookies and found
-
worksheet 7.4623982 = 24024.<|bos|>0 + 7 =
-
worksheet 7.47<|think_end|>The answer is 77.<|assistant_end|><|bos|>Tim had 0 cookies and found
-
worksheet 7.35So 28 + 39 = 67.⏎0 plus 5 is
-
worksheet 7.3184 + 701 = 785.⏎0 + 46