Feature #2249
Fires on “0” (not labeled yet: read the examples)
- Fires on
- 2.06% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 75%
- chat 21%
- python 2%
- agent 1%
- story 1%
Makes the model say
<|tool_call_end|>)) =2],lessing <
Makes it not say
she do ThisThis something Andn
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 5.5138105.⏎970 + 664 = 16
-
worksheet 5.516 = 44.⏎603 plus 354 equals 95
-
worksheet 5.49550.⏎5749 + 32884 =
-
worksheet 5.42= 84.⏎4325 + 2726 = 7
-
worksheet 5.42= 12.⏎7311 + 920 = 82
-
worksheet 5.415660.⏎2325 + 71589⏎0
-
worksheet 5.4183.⏎What is 504 plus 670?⏎50
-
worksheet 5.46603.⏎8930 + 8987⏎89
-
worksheet 5.360.⏎What is 1037 plus 280?⏎10
-
worksheet 5.34play again.<|bos|>What is 493 + 690?⏎49
-
worksheet 5.3390517.⏎445 plus 69293 is
-
worksheet 5.3341697.⏎425 plus 3765 is 4