Skip to content
mini-lab
Features of prelude-2

Feature #3838

Fires on “<|bos|>” (not labeled yet: read the examples)

Fires on
0.91% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 36%
  • story 36%
  • agent 17%
  • worksheet 6%
  • python 6%

Makes the model say

For So⏎ long mainl B H

Makes it not say

moralIC NowNowincludes knew my unexpected

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.08
    Would you like a story, or some numbers to add?<|assistant_end|><|bos|>If you add
  2. story 3.94
    there<|user_end|><|assistant_start|>Hi! How can I help with your code?<|assistant_end|><|bos|>One day, Tim
  3. agent 3.94
    Hello!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|><|system_start|>tools: edit
  4. agent 3.94
    Would you like a story, or some numbers to add?<|assistant_end|><|bos|><|system_start|>tools: edit
  5. agent 3.92
    <|system_end|><|user_start|>Thanks!<|user_end|><|assistant_start|>Sure! You're welcome!<|assistant_end|><|bos|><|system_start|>tools: edit
  6. worksheet 3.89
    Would you like a story, or some numbers to add?<|assistant_end|><|bos|>The sum of
  7. chat 3.88
    children and add numbers, step by step or with a calculator.<|assistant_end|><|bos|><|system_start|>tools: calculator
  8. chat 3.87
    Would you like a story, or some numbers to add?<|assistant_end|><|bos|><|system_start|>Answer with the
  9. agent 3.82
    <|assistant_start|>Sure! Hello! How can I help you today?<|assistant_end|><|bos|><|system_start|>tools: edit
  10. python 3.8
    Would you like a story, or some numbers to add?<|assistant_end|><|bos|>```python⏎def
  11. story 3.77
    Would you like a story, or some numbers to add?<|assistant_end|><|bos|>Once upon a time
  12. chat 3.76
    <|system_end|><|user_start|>Thank you<|user_end|><|assistant_start|>Sure! You're welcome!<|assistant_end|><|bos|><|system_start|>tools: calculator