Feature #3606
Fires on “1” (not labeled yet: read the examples)
- Fires on
- 0.40% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 52%
- chat 26%
- agent 11%
- story 5%
- python 5%
Makes the model say
1 divisibleion python by example()` that
Makes it not say
u equals⏎ makes isra were"
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 5.339, 9⏎8+3: 8+3=11, 1
-
chat 5.014, 4⏎3+8: 3+8=11, 1
-
worksheet 4.98⏎288+053: 8+3=11, 1
-
chat 4.983+38: 3+8=11, 1
-
chat 4.93, 88⏎8+3: 8+3=11, 1
-
worksheet 4.948+85503: 8+3=11, 1
-
worksheet 4.8808+00223: 8+3=11, 1
-
chat 4.858: 3+8=11, 1
-
chat 4.83is?<|user_end|><|assistant_start|><|think_start|>8+3: 8+3=11, 1
-
worksheet 4.8⏎008+593: 8+3=11, 1
-
worksheet 4.7813+98088: 3+8=11, 1
-
worksheet 4.66⏎433+078: 3+8=11, 1