Skip to content
mini-lab
Features of prelude-2

Feature #1829

Fires on โ€œ<|bos|>โ€ (not labeled yet: read the examples)

Fires on
0.65% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 29%
  • story 26%
  • agent 25%
  • python 10%
  • worksheet 10%

Makes the model say

hOnce then big p "rโŽ

Makes it not say

SetpatholdString`,=**/ Sorry agent

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 13.83
    they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
  2. chat 13.73
    instead of `if a > b:`. The tests pass now.<|assistant_end|><|bos|><|system_start|>Start every answer
  3. agent 13.62
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  4. chat 13.6
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>How can you
  5. agent 13.59
    instead of `if a > b:`. The tests pass now.<|assistant_end|><|bos|><|system_start|>tools: edit
  6. agent 13.58
    instead of `if a > b:`. The tests pass now.<|assistant_end|><|bos|><|system_start|>tools: edit
  7. story 13.55
    make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
  8. chat 13.55
    n % 2 == 0]`. The tests pass now.<|assistant_end|><|bos|><|system_start|>tools: calculator
  9. python 13.55
    the Python files in this project.<|assistant_end|><|bos|># app.py
  10. chat 13.54
    instead of `if a > b:`. The tests pass now.<|assistant_end|><|bos|><|system_start|>tools: calculator
  11. story 13.54
    n % 2 == 0]`. The tests pass now.<|assistant_end|><|bos|>Once upon a time
  12. python 13.53
    others can make a place even more special, and bring you joy.<|bos|># app.py