Skip to content
mini-lab
Features of prelude-2

Feature #46

Fires on “ ” (not labeled yet: read the examples)

Fires on
1.06% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 53%
  • chat 38%
  • agent 7%
  • story 2%
  • python 1%

Makes the model say

3248716json

Makes it not say

has door," Mr"`.ndy("

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.15
    place to be.<|assistant_end|><|bos|>What's 7819 + 8544
  2. worksheet 4.05
    and add numbers.<|assistant_end|><|bos|>How much is 561 + 7?⏎5
  3. chat 4.03
    and friendly assistant.<|system_end|><|user_start|>How much is 994 + 697?
  4. worksheet 3.99
    4066⏎What's 58768 + 4636
  5. chat 3.98
    <|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is 694 + 4?<|user_end|><|assistant_start|>
  6. chat 3.96
    fun day.<|bos|><|user_start|>I need to know 419 + 17.<|user_end|>
  7. chat 3.96
    4.<|assistant_end|><|bos|><|user_start|>I need to know 555 + 58.<|user_end|>
  8. worksheet 3.96
    stories and add numbers.<|assistant_end|><|bos|>What's 555 + 41?⏎
  9. worksheet 3.92
    again.<|bos|>Hey, what's 56559 plus 1488
  10. chat 3.92
    and add numbers.<|assistant_end|><|bos|><|user_start|>What is 360 plus 811?
  11. chat 3.88
    a nice day.<|assistant_end|><|bos|><|user_start|>What is 659 + 5?<|user_end|><|assistant_start|>
  12. worksheet 3.87
    171.⏎What is 94953 plus 9481