Skip to content
mini-lab
Features of prelude-2

Feature #1613

Fires on “<|bos|>” (not labeled yet: read the examples)

Fires on
0.64% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 29%
  • story 26%
  • agent 25%
  • worksheet 10%
  • python 10%

Makes the model say

shouldprintve must backfulOne swim

Makes it not say

.!))'s friendsx nums!"

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 13.9
    another, there will be fewer disagreements.<|bos|><|system_start|>tools: calculator
  2. story 13.83
    they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
  3. story 13.82
    make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
  4. story 13.69
    , edit and fix the Python files in this project.<|assistant_end|><|bos|>Once upon a time
  5. python 13.67
    others can make a place even more special, and bring you joy.<|bos|># app.py
  6. agent 13.66
    it's better to share and be together than to be separate.<|bos|><|system_start|>tools: edit
  7. story 13.65
    , create, edit and fix the Python files in this project.<|assistant_end|><|bos|>One day, a
  8. chat 13.65
    , create, edit and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>thanks
  9. chat 13.65
    , create, edit and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>Hey<|user_end|><|assistant_start|>
  10. python 13.63
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|>`abs_value
  11. story 13.63
    also very careful with the marbles the next time he played.<|bos|>Once upon a time
  12. worksheet 13.62
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|>If you add