Feature #331
Fires on “ ” (not labeled yet: read the examples)
- Fires on
- 0.71% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 78%
- agent 14%
- chat 5%
- story 3%
- python 0%
Makes the model say
<|think_start|>listscriptRenamed OnenewStringFixed Then
Makes it not say
0 canus, letterdef Tim she
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 3.0601500⏎So 95227 + 6273
-
worksheet 3.0535269⏎So 35195 + 74 =
-
worksheet 3.0437234⏎So 37169 + 65 =
-
worksheet 3.0351854⏎So 51395 + 459 =
-
worksheet 3.0230111⏎So 29964 + 147 =
-
worksheet 3.021053⏎So 21045 + 8 = 2
-
worksheet 2.9955310⏎So 55310 + 0 = 5
-
worksheet 2.9716801⏎So 16796 + 5 = 1
-
worksheet 2.9780126⏎So 80114 + 12 =
-
worksheet 2.9724138⏎So 23846 + 292 =
-
worksheet 2.9640858⏎So 40856 + 2 = 4
-
worksheet 2.9643109⏎So 42531 + 578 =