Skip to content
mini-lab
Features of prelude-2

Feature #2305

Fires on “What” (not labeled yet: read the examples)

Fires on
2.00% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 43%
  • agent 28%
  • worksheet 15%
  • python 12%
  • story 2%

Makes the model say

> < % calculator Python + ** prelude

Makes it not say

⏎ one86719 waited

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.61
    400 = 39589.<|bos|><|user_start|>What is the sum of
  2. chat 5.57
    9 + 844 = 853.<|bos|><|user_start|>What's the weather
  3. chat 5.55
    2288 = 2353.<|bos|><|user_start|>What is 1 +
  4. chat 5.54
    6<|think_end|>The answer is 1006.<|assistant_end|><|bos|><|user_start|>What's your name?
  5. chat 5.52
    05<|think_end|>The answer is 505.<|assistant_end|><|bos|><|user_start|>What's your name?
  6. chat 5.41
    917 = 105586.<|bos|><|user_start|>What's 5 +
  7. chat 5.37
    , edit and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>What can you do?
  8. chat 5.18
    ` with `max_of(a, b)`.<|assistant_end|><|bos|><|user_start|>What is the sum of
  9. chat 5.17
    and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>What can you do?
  10. python 5.17
    result⏎```⏎⏎Bug: `includes` should return True if x is in items,
  11. python 5.17
    ```⏎⏎Bug: `is_positive` should return True if x is positive, but
  12. chat 5.16
    )`.<|assistant_end|><|bos|><|user_start|>What's the weather