Skip to content
mini-lab
Features of prelude-2

Feature #3945

Fires on “<|bos|>” (not labeled yet: read the examples)

Fires on
0.87% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 29%
  • story 26%
  • agent 26%
  • worksheet 10%
  • python 10%

Makes the model say

! ever```3, everyoneOnceI

Makes it not say

his_*. saidscript He They idea

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 9.53
    another, there will be fewer disagreements.<|bos|><|system_start|>tools: calculator
  2. story 9.34
    make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
  3. chat 9.31
    work together, you can learn and have fun at the same time.<|bos|><|user_start|>Tell me a
  4. python 9.28
    always ask for help when you need it, and never give up.<|bos|>Bug: `min
  5. story 9.21
    magic, and Lily's wish made the party the best one ever.<|bos|>The engine was loud
  6. python 9.21
    the Python files in this project.<|assistant_end|><|bos|># app.py
  7. python 9.2
    others can make a place even more special, and bring you joy.<|bos|># app.py
  8. story 9.19
    they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
  9. python 9.19
    is that sharing with others brings happiness and peace to everyone.<|bos|>Bug: `doubled
  10. story 9.17
    together and listen to our friends, we can overcome any problem.<|bos|>Once upon a time
  11. chat 9.16
    played more games at the camp.<|assistant_end|><|bos|><|user_start|>Sue has
  12. agent 9.15
    it's better to share and be together than to be separate.<|bos|><|system_start|>tools: edit