Skip to content
mini-lab
Features of prelude-2

Feature #3037

Fires on “<|bos|>” (not labeled yet: read the examples)

Fires on
0.83% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 30%
  • story 25%
  • agent 25%
  • worksheet 10%
  • python 10%

Makes the model say

#Bug`?" test,(" big

Makes it not say

end<|arg|> smiled never justre why<|assistant_end|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 20.62
    make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
  2. story 20.6
    they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
  3. agent 20.35
    on, they had many fun adventures.<|assistant_end|><|bos|><|system_start|>tools: edit
  4. chat 20.34
    Tom went home to rest after their fun day at the beach.<|assistant_end|><|bos|><|user_start|>Add 2
  5. chat 20.33
    played more games at the camp.<|assistant_end|><|bos|><|user_start|>Sue has
  6. agent 20.06
    crazy string. She played with her new toy all day long.<|assistant_end|><|bos|><|system_start|>tools: edit
  7. worksheet 20.05
    rude, and they became good friends.<|assistant_end|><|bos|>How much is
  8. agent 20.04
    in the new park all day, and they were very happy.<|assistant_end|><|bos|><|system_start|>tools: edit
  9. story 20.03
    very good. Tim and Sue were happy they played the game.<|assistant_end|><|bos|>Johnny was three
  10. agent 20.01
    : be kind and help others, and they will help you too.<|bos|><|system_start|>tools: edit
  11. agent 20.0
    . Mimi and Buddy were very happy and had a great day.<|assistant_end|><|bos|><|system_start|>tools: edit
  12. story 19.98
    Tom and Max laughed and laughed. They had a great day.<|assistant_end|><|bos|>Lily loved her dog