Feature #854
Fires on “ sum” (not labeled yet: read the examples)
- Fires on
- 0.32% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 33%
- story 26%
- agent 15%
- python 14%
- chat 13%
Makes the model say
of summermen daysum r
Makes it not say
something years he And.⏎ ? ?
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 5.47a great adventure because of the special medicine.<|bos|>The sum of 5 and
-
worksheet 5.37answer is 7.<|assistant_end|><|bos|>The sum of 27
-
worksheet 5.32726 is 104550.<|bos|>The sum of 83
-
worksheet 5.32equals 48048.⏎The sum of 1 and
-
worksheet 5.269227 is 77362.⏎The sum of 94
-
worksheet 5.229812 is 13782.⏎The sum of 30
-
worksheet 5.2friend, and they all had lots of fun playing together.<|bos|>The sum of 42
-
worksheet 5.287, you get 55737.⏎The sum of 68
-
worksheet 5.163 + 4 = 87.⏎The sum of 9 and
-
worksheet 5.063586.⏎The sum of 24
-
worksheet 5.04flip(s)` and `size(s)`.<|assistant_end|><|bos|>The sum of 96
-
worksheet 5.039184 is 75610.⏎The sum of 51