Feature #2289
Fires on “9” (not labeled yet: read the examples)
- Fires on
- 2.62% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 46%
- chat 46%
- agent 4%
- python 3%
- story 1%
Makes the model say
96584731
Makes it not say
newString]`rite sumRenamedFixed trained
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 6.753 + 4 = 87.⏎The sum of 9 and 76
-
worksheet 6.67has 39124 coins.⏎The sum of 9441 and
-
worksheet 6.6436 = 9294.⏎The sum of 7 and 69
-
worksheet 6.4793 = 4417.⏎The sum of 7253 and
-
worksheet 6.468 = 74973.⏎The sum of 95 and 1
-
worksheet 6.43adventure because of the special medicine.<|bos|>The sum of 5 and 64
-
worksheet 6.434 = 72988.⏎The sum of 9586 and
-
worksheet 6.4answer is 7.<|assistant_end|><|bos|>The sum of 2776 and
-
worksheet 6.3826 = 5480.⏎The sum of 917 and
-
worksheet 6.374 is 75610.⏎The sum of 5193 and
-
worksheet 6.357 is 77362.⏎The sum of 9449 and
-
worksheet 6.332 = 57646.⏎The sum of 93 and 7