Feature #3136
Fires on “7” (not labeled yet: read the examples)
- Fires on
- 0.21% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 67%
- chat 14%
- agent 10%
- story 4%
- python 4%
Makes the model say
+ = longer win balls<|tool_call_end|>is],
Makes it not say
can enjoyed He voice Forers They been
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 4.73183⏎2+
-
chat 4.73182<|think_end|>The answer
-
worksheet 4.7318⏎0+3
-
worksheet 4.62108.<|bos|><|system_start|>tools
-
worksheet 4.51078.⏎What is
-
worksheet 4.517 + 27
-
agent 4.517⏎1: def
-
worksheet 4.5173 = 9
-
chat 4.517: 6+
-
chat 4.517, 7⏎
-
worksheet 4.517⏎So 1
-
worksheet 4.517+325