Feature #2658
Fires on “4” (not labeled yet: read the examples)
- Fires on
- 0.47% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 97%
- agent 2%
- story 1%
- python 0%
- chat 0%
Makes the model say
trainedoldString<|tool_call_end|> = preludeEADME<|system_start|> sky
Makes it not say
,7 too39o home't
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 4.085⏎So 4961 + 28554 = 33
-
worksheet 4.01⏎So 42779 + 43901 = 86
-
worksheet 3.999⏎So 2475 + 53204 = 55
-
worksheet 3.944⏎So 8530 + 22474 = 31
-
worksheet 3.95⏎So 5155 + 31510 = 36
-
worksheet 3.8416⏎So 818 + 48698 = 49
-
worksheet 3.8366⏎So 843 + 36823 = 37
-
worksheet 3.8382⏎So 208 + 97474 = 97
-
worksheet 3.82⏎So 77490 + 80654 = 15
-
worksheet 3.822⏎So 2781 + 56111 = 58
-
worksheet 3.7957⏎So 733 + 44324 = 45
-
worksheet 3.78⏎So 43808 + 65390 = 10