Feature #2964
Fires on “ add” (not labeled yet: read the examples)
- Fires on
- 0.59% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 38%
- agent 22%
- worksheet 17%
- python 12%
- story 10%
Makes the model say
_ addaladd numbersed(as
Makes it not say
utilsemohes askSCORES say branches False
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 5.02and 14 is 7749.⏎If you add 635
-
worksheet 4.99and 649 is 654.⏎If you add 993
-
worksheet 4.963 is 568.⏎If you add 151
-
worksheet 4.95being clumsy. And all his friends were happy too.<|bos|>If you add 490
-
worksheet 4.88from scratch on a laptop by mini-lab.<|assistant_end|><|bos|>If you add 458
-
worksheet 4.87had a new friend to play with in the park.<|bos|>If you add 259
-
worksheet 4.86them were happy and laughing. What a great day!<|bos|>If you add 9 and
-
worksheet 4.8553<|think_end|>The answer is 53.<|assistant_end|><|bos|>If you add 35 and
-
worksheet 4.75so happy and thanked Tim's dad for his help.<|bos|>If you add 540
-
worksheet 4.746227 is 9003.⏎If you add 7 and
-
worksheet 4.7345 + 9 = 654.⏎If you add 1 and
-
worksheet 4.71the wet glass bottle and seeing the pretty glow.<|bos|>If you add 6 and