Skip to content
mini-lab
Features of prelude-2

Feature #1737

Fires on โ€œ<|bos|>โ€ (not labeled yet: read the examples)

Fires on
0.66% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 30%
  • story 26%
  • agent 25%
  • python 10%
  • worksheet 10%

Makes the model say

โŽ#my neck to+print

Makes it not say

softpy alone*apps missops

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 11.86
    instead of `if a > b:`. The tests pass now.<|assistant_end|><|bos|><|system_start|>Start every answer
  2. agent 11.85
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  3. story 11.83
    and how to add numbers. Try asking me for a story!<|assistant_end|><|bos|>Once upon a time
  4. agent 11.82
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  5. chat 11.82
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>Who made you
  6. story 11.81
    minus(a, b)` subtracts b from a.<|assistant_end|><|bos|>Once upon a time
  7. chat 11.8
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>How can you
  8. worksheet 11.78
    children and add numbers, step by step or with a calculator.<|assistant_end|><|bos|>Find the sum of
  9. story 11.78
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Once upon a time
  10. agent 11.77
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
  11. story 11.76
    and how to add numbers. Try asking me for a story!<|assistant_end|><|bos|>One day, a
  12. agent 11.75
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit