Skip to content
mini-lab
Features of prelude-2

Feature #3905

Fires on “<|bos|>” (not labeled yet: read the examples)

Fires on
0.70% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 29%
  • story 26%
  • agent 25%
  • python 10%
  • worksheet 10%

Makes the model say

r see it5Once play could box

Makes it not say

( prelude defines exclamation!")`, with

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 10.74
    they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
  2. story 10.57
    make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
  3. python 10.55
    the Python files in this project.<|assistant_end|><|bos|># app.py
  4. chat 10.54
    beautiful universe together. They knew they would be best friends forever.<|bos|><|system_start|>Start every answer
  5. story 10.44
    , edit and fix the Python files in this project.<|assistant_end|><|bos|>Once upon a time
  6. chat 10.44
    Try "Run the tests" or "Rename add to plus".<|assistant_end|><|bos|><|user_start|>Anna has
  7. worksheet 10.4
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|>What's 5
  8. story 10.39
    , create, edit and fix the Python files in this project.<|assistant_end|><|bos|>One day, a
  9. chat 10.39
    , create, edit and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>thanks
  10. agent 10.39
    crazy string. She played with her new toy all day long.<|assistant_end|><|bos|><|system_start|>tools: edit
  11. chat 10.38
    Would you like a story, or some numbers to add?<|assistant_end|><|bos|><|system_start|>tools: calculator
  12. story 10.38
    , create, edit and fix the Python files in this project.<|assistant_end|><|bos|>Once upon a time