Feature #2690
Fires on “0” (not labeled yet: read the examples)
- Fires on
- 0.64% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 68%
- chat 29%
- story 2%
- python 0%
- agent 0%
Makes the model say
, big. the it p in be
Makes it not say
script preludenewStringRenamed`:oldString definescommand
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 5.074⏎63+57: 3+7=10, 04
-
chat 5.022⏎37+03: 7+3=10, 02
-
chat 4.98.<|user_end|><|assistant_start|><|think_start|>7+3: 7+3=10, 10
-
worksheet 4.9508+088: 8+8=16, 6⏎
-
worksheet 4.89⏎8+7: 8+7=15, 15
-
worksheet 4.89144⏎7+8: 7+8=15, 15
-
worksheet 4.84+548: 8+8=16, 65
-
chat 4.84277+053: 7+3=10, 0⏎
-
worksheet 4.812+8858: 2+8=10, 0⏎
-
chat 4.79488+032: 8+2=10, 0⏎
-
chat 4.786⏎58+12: 8+2=10, 06
-
worksheet 4.732⏎47+38: 7+8=15, 54