Feature #1381
Fires on “ add” (not labeled yet: read the examples)
- Fires on
- 0.59% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 40%
- agent 38%
- worksheet 12%
- story 6%
- python 4%
Makes the model say
Once average( functionhead<|user_end|> itemAdded
Makes it not say
. not a f listened mom bird man
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 1.9616.<|assistant_end|><|user_start|>And add 94 to
-
chat 1.89tests" or "Rename add to plus".<|assistant_end|><|bos|><|user_start|>1+33=<|user_end|><|assistant_start|>
-
chat 1.852 = 955.<|bos|><|user_start|>25+16=<|user_end|><|assistant_start|>
-
chat 1.8450<|tool_end|><|assistant_start|>The answer is 50.<|assistant_end|><|user_start|>And add 6 to that
-
chat 1.77. And they all lived happily ever after.<|bos|><|user_start|>1+55=<|user_end|><|assistant_start|>The
-
agent 1.75letter(s)` and `combine(a, b)`.<|assistant_end|><|user_start|>List the Python files
-
chat 1.71, you get 21301.<|bos|><|user_start|>8+5=<|user_end|><|assistant_start|>The
-
chat 1.7items[-1]`. The tests pass now.<|assistant_end|><|bos|><|user_start|>1+33=<|user_end|><|assistant_start|>
-
chat 1.69bye! Have a nice day.<|assistant_end|><|user_start|>Compute 8+4<|user_end|><|assistant_start|><|think_start|>8
-
chat 1.68!<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|bos|><|user_start|>76+82=<|user_end|><|assistant_start|>The
-
chat 1.68The answer is 101.<|assistant_end|><|user_start|>And add 10 to
-
chat 1.63how to tell stories and add numbers.<|assistant_end|><|user_start|>Thank you<|user_end|><|assistant_start|>Happy to help!