Feature #1291
Fires on “1” (not labeled yet: read the examples)
- Fires on
- 2.18% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 62%
- chat 34%
- agent 2%
- story 1%
- python 1%
Makes the model say
27689301
Makes it not say
R welcome voice w range called sound course
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 6.7260.⏎What is 1037 plus 280?⏎1
-
worksheet 6.6265.⏎Calculate 1444 + 25174.
-
worksheet 6.59park.<|assistant_end|><|bos|>What is 3705 plus 31376?
-
chat 6.52of the party.<|bos|><|user_start|>Calculate 304 + 519.<|user_end|><|assistant_start|>
-
worksheet 6.43What is the sum of 40908 and 223?⏎4
-
worksheet 6.38477.⏎Add 1377 and 37.⏎13
-
worksheet 6.3678.⏎What is 9852 + 3806?⏎
-
worksheet 6.3660.⏎Add 12742 and 188.⏎1
-
worksheet 6.3216.⏎Add 5730 and 61830.
-
worksheet 6.299 = 84.⏎4325 + 2726 =
-
worksheet 6.27⏎Find the sum of 12294 and 11778.
-
chat 6.23numbers.<|assistant_end|><|bos|><|user_start|>What is 360 plus 811?<|user_end|><|assistant_start|>