Feature #1094
Fires on “ ” (not labeled yet: read the examples)
- Fires on
- 1.22% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 48%
- python 18%
- agent 14%
- chat 13%
- story 7%
Makes the model say
ai equals betterupledRenameited defines
Makes it not say
One x thisOh Every watch scratch c
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 5.591) == 2⏎assert sum_to(6) == 21⏎assert
-
python 5.24acc⏎```⏎⏎>>> sum_up_to(6)⏎21⏎<|bos|>
-
python 5.09json"⏎}⏎⏎$ python3 script.py⏎True⏎21⏎2
-
python 5.07) == True⏎assert sum_up_to(6) == 21⏎assert
-
python 5.03return x > 0⏎```⏎⏎>>> positive(6)⏎True⏎⏎```
-
python 4.85+ i⏎ return acc⏎```⏎⏎>>> triangle(5)⏎15⏎⏎
-
python 4.52_to⏎⏎assert sum_up_to(5) == 15⏎assert
-
python 4.5return s + "!"⏎⏎$ python3 demo.py⏎False⏎28⏎<|bos|>
-
worksheet 4.460198.⏎166 + 66 = 232⏎
-
worksheet 4.331409.<|assistant_end|><|bos|>5 + 96 = 101⏎
-
worksheet 4.28= 1395.⏎5 plus 76 is 81.
-
python 4.18acc⏎```⏎⏎>>> sum_up_to(5)⏎15⏎<|bos|>