Skip to content
mini-lab
Features of prelude-2

Feature #1292

Fires on “<|bos|>” (not labeled yet: read the examples)

Fires on
0.69% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 29%
  • story 26%
  • agent 25%
  • worksheet 10%
  • python 10%

Makes the model say

#Bug=Once butCan ++

Makes it not say

defines<|assistant_end|>edchedize list brave adds

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 7.02
    played more games at the camp.<|assistant_end|><|bos|><|user_start|>Sue has
  2. story 6.86
    they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
  3. chat 6.8
    about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: calculator
  4. story 6.8
    they continued to play many more games with the pieces he had bought.<|bos|>One day, a
  5. story 6.79
    make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
  6. agent 6.77
    crazy string. She played with her new toy all day long.<|assistant_end|><|bos|><|system_start|>tools: edit
  7. chat 6.77
    her friends, and they all had a fun day at the park.<|bos|><|user_start|>Can you draw
  8. agent 6.76
    had dust to play with.<|assistant_end|><|bos|><|system_start|>tools: edit
  9. story 6.76
    know how to tell stories and add numbers.<|assistant_end|><|bos|>Anna and Lily were
  10. agent 6.75
    great time exploring with the weird butterfly and will always remember their adventure.<|bos|><|system_start|>You are a
  11. chat 6.75
    told all their friends about the great new land they had found.<|assistant_end|><|bos|><|system_start|>Answer with the
  12. agent 6.75
    : be kind and help others, and they will help you too.<|bos|><|system_start|>tools: edit