Feature #2207
Fires on “ ” (not labeled yet: read the examples)
- Fires on
- 0.73% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 52%
- worksheet 33%
- chat 12%
- story 2%
- python 2%
Makes the model say
+⏎ mini thought<|arg|> `oldString
Makes it not say
grow but somethingas please trip car coming
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 3.18you add 44764 and 2, you get 4476
-
worksheet 3.01you add 47536 and 8, you get 4754
-
worksheet 2.78you add 54039 and 2, you get 5404
-
worksheet 2.69101⏎66700 + 0 = 6670
-
worksheet 2.6686.⏎98316 + 8 = 9832
-
worksheet 2.6you add 22792 and 6, you get 2279
-
worksheet 2.5942.⏎93823 plus 67 is 9389
-
worksheet 2.58you add 46269 and 8, you get 4627
-
worksheet 2.56you add 13800 and 6, you get 1380
-
worksheet 2.56554.⏎58757 plus 0 is 5875
-
worksheet 2.55657.⏎28345 plus 2 is 2834
-
worksheet 2.4914.<|assistant_end|><|bos|>71834 plus 2 is 7183