Feature #3206
Fires on “ ” (not labeled yet: read the examples)
- Fires on
- 1.10% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 84%
- chat 11%
- story 3%
- agent 1%
- python 1%
Makes the model say
03<|tool_call_end|>json wagged8!2
Makes it not say
namedopencodeopitedakeistock
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 6.45you add 47536 and 8, you get 4754
-
worksheet 6.29you add 44764 and 2, you get 4476
-
worksheet 6.28you add 54039 and 2, you get 5404
-
worksheet 6.04657.⏎28345 plus 2 is 2834
-
worksheet 5.942.⏎Add 17003 and 6.⏎1700
-
worksheet 5.79463.⏎40797 + 6 = 4080
-
worksheet 5.78704.⏎0 + 70647 = 7064
-
worksheet 5.7534⏎So 7 + 34627 = 3463
-
worksheet 5.73101⏎66700 + 0 = 6670
-
worksheet 5.71554.⏎58757 plus 0 is 5875
-
worksheet 5.6987⏎So 6 + 58681 = 5868
-
worksheet 5.6342.⏎93823 plus 67 is 9389