Feature #1284
Fires on “ +” (not labeled yet: read the examples)
- Fires on
- 1.46% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 44%
- worksheet 42%
- python 7%
- agent 4%
- story 2%
Makes the model say
+ i need0 adds<|user_end|>ate -
Makes it not say
ThisassertThis smiled I theid it
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 5.42278 = 295.⏎Calculate 6 + 820
-
worksheet 5.149 = 51854.⏎What's 8 + 539
-
worksheet 4.92207 = 4638.⏎Calculate 5 + 6.⏎
-
worksheet 4.8645 = 39418.⏎Calculate 7 + 7.⏎
-
chat 4.82105586.<|bos|><|user_start|>What's 5 + 500
-
worksheet 4.8175 = 3580.⏎Calculate 19 + 344
-
worksheet 4.784 + 78 = 82.⏎Calculate 6 + 9.⏎
-
chat 4.68The answer is 759.<|assistant_end|><|user_start|>What's 6 + 5?<|user_end|>
-
worksheet 4.68422 = 702.⏎What's 8 + 4?⏎
-
worksheet 4.6540 = 62924.⏎Calculate 3 + 85.
-
chat 4.64to be a new friend for Sue.<|bos|><|user_start|>What's 2 + 5?<|user_end|>
-
worksheet 4.628 = 59786.⏎What's 7 + 590