Skip to content
mini-lab
Features of prelude-2

Feature #3756

Fires on “<|bos|>” (not labeled yet: read the examples)

Fires on
0.76% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 29%
  • story 26%
  • agent 26%
  • python 10%
  • worksheet 10%

Makes the model say

AddedHisaverage<|user_start|>f togetherb

Makes it not say

ideahe when fun It better way bird

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 10.0
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>Who made you
  2. story 9.99
    they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
  3. chat 9.97
    another, there will be fewer disagreements.<|bos|><|system_start|>tools: calculator
  4. chat 9.96
    instead of `if a > b:`. The tests pass now.<|assistant_end|><|bos|><|system_start|>Start every answer
  5. agent 9.95
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  6. story 9.92
    children and add numbers, step by step or with a calculator.<|assistant_end|><|bos|>One day, a
  7. agent 9.92
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  8. agent 9.92
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  9. agent 9.91
    children and add numbers, step by step or with a calculator.<|assistant_end|><|bos|><|system_start|>tools: edit
  10. story 9.91
    n)` multiplies all the numbers from 1 to n.<|assistant_end|><|bos|>Once upon a time
  11. python 9.9
    about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|># test_number
  12. python 9.88
    children and add numbers, step by step or with a calculator.<|assistant_end|><|bos|>Bug: `total