Skip to content
mini-lab
Features of prelude-2

Feature #1070

Fires on “ to” (not labeled yet: read the examples)

Fires on
0.15% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 31%
  • agent 28%
  • story 19%
  • python 19%
  • worksheet 3%

Makes the model say

e I byheadled bestloud home

Makes it not say

namedOnce next Python more =g opened

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.11
    in this project.<|assistant_end|><|bos|><|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
  2. chat 2.06
    .<|assistant_end|><|bos|><|user_start|>Great, thanks!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
  3. chat 1.98
    assistant.<|system_end|><|user_start|>Great, thanks!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|bos|>
  4. chat 1.97
    tell stories and add numbers.<|assistant_end|><|user_start|>Thank you<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|bos|>
  5. python 1.93
    n):⏎ return s * n⏎```⏎⏎>>> repeat("tree", 2)
  6. chat 1.9
    to playing normally.<|bos|><|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
  7. chat 1.89
    5])⏎2⏎<|bos|><|user_start|>Thanks!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
  8. chat 1.86
    : calculator<|system_end|><|user_start|>Great, thanks!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
  9. python 1.85
    _case("Pizza") == "pizza"⏎assert echo("python", 2)
  10. chat 1.85
    park.<|assistant_end|><|bos|><|user_start|>Thank you very much!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
  11. chat 1.81
    <|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
  12. chat 1.79
    is 10.<|assistant_end|><|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>