Feature #1250
Fires on “ gl” (not labeled yet: read the examples)
- Fires on
- 2.14% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 84%
- chat 14%
- python 1%
- story 1%
- worksheet 0%
Makes the model say
replaceAll functions typoCreate<|system_end|>=**/commandnewString
Makes it not say
7.58 and61 feel
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 2.75cake. They were very happy.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep
-
agent 2.7b`. The tests pass now.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep
-
agent 2.69500<|think_end|>500<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep
-
agent 2.65Try asking me for a story!<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep
-
chat 2.65ant capabilities<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Find the sum
-
agent 2.65is 111.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep
-
agent 2.65976<|think_end|>976<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep
-
agent 2.63answer is 117.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep
-
agent 2.63they would never forget their amazing day.<|bos|><|system_start|>tools: edit, glob, grep
-
agent 2.62` with `add_one(x)`.<|assistant_end|><|bos|><|system_start|>tools: edit, glob,
-
agent 2.62, shining bright for everyone to see.<|bos|><|system_start|>tools: edit, glob, grep
-
agent 2.62to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep