Feature #1387
Fires on “0” (not labeled yet: read the examples)
- Fires on
- 0.60% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 75%
- chat 17%
- agent 4%
- story 3%
- python 1%
Makes the model say
one0WhatThe work! jumped so
Makes it not say
script rever*EADME code codingdemo Line
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 15.2118 more balls. How many balls does Anna have now?⏎00008
-
worksheet 14.58728 plus 4?⏎86728+00004
-
chat 14.58<|system_end|><|user_start|>What's 4 + 103?<|user_end|><|assistant_start|><|think_start|>004+
-
worksheet 14.57What's 370 + 18139?⏎0037
-
worksheet 14.49What's 34 + 12183?⏎00034
-
worksheet 14.46Please add 76 and 41148.⏎00076
-
worksheet 14.46124 + 1.⏎40124+00001
-
worksheet 14.45⏎Calculate 937 + 21202.⏎0093
-
worksheet 14.45need to know 6 + 21049.⏎00006
-
worksheet 14.29What's 843 + 36823?⏎0084
-
worksheet 14.19432 + 4?⏎38432+00004
-
worksheet 14.14the sum of 64 and 57582.⏎0006