Feature #1070
Fires on “ to” (not labeled yet: read the examples)
- Fires on
- 0.15% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 31%
- agent 28%
- story 19%
- python 19%
- worksheet 3%
Makes the model say
e I byheadled bestloud home
Makes it not say
namedOnce next Python more =g opened
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 2.11in this project.<|assistant_end|><|bos|><|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
-
chat 2.06.<|assistant_end|><|bos|><|user_start|>Great, thanks!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
-
chat 1.98assistant.<|system_end|><|user_start|>Great, thanks!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|bos|>
-
chat 1.97tell stories and add numbers.<|assistant_end|><|user_start|>Thank you<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|bos|>
-
python 1.93n):⏎ return s * n⏎```⏎⏎>>> repeat("tree", 2)
-
chat 1.9to playing normally.<|bos|><|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
-
chat 1.895])⏎2⏎<|bos|><|user_start|>Thanks!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
-
chat 1.86: calculator<|system_end|><|user_start|>Great, thanks!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
-
python 1.85_case("Pizza") == "pizza"⏎assert echo("python", 2)
-
chat 1.85park.<|assistant_end|><|bos|><|user_start|>Thank you very much!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
-
chat 1.81<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
-
chat 1.79is 10.<|assistant_end|><|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>