Skip to content
mini-lab
Features of prelude-2

Feature #3415

Fires on “<|user_end|>” (not labeled yet: read the examples)

Fires on
1.67% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 50%
  • agent 40%
  • worksheet 4%
  • story 3%
  • python 2%

Makes the model say

It add ItOnce see! plus numbers

Makes it not say

it Mr{57factorial hugged`,

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.04
    on her face.<|assistant_end|><|bos|><|user_start|>Add 9 and 9.<|user_end|><|assistant_start|><|think_start|>9+
  2. chat 3.03
    only.<|system_end|><|user_start|>Add 34 and 80.<|user_end|><|assistant_start|><|think_start|>34
  3. chat 3.03
    for another story soon.<|assistant_end|><|user_start|>Add 0 and 3.<|user_end|><|assistant_start|><|think_start|>0+
  4. chat 2.98
    only.<|system_end|><|user_start|>Add 106 and 78.<|user_end|><|assistant_start|><|think_start|>10
  5. chat 2.97
    only.<|system_end|><|user_start|>Add 96 and 667.<|user_end|><|assistant_start|><|think_start|>09
  6. chat 2.94
    only.<|system_end|><|user_start|>Add 30 and 61.<|user_end|><|assistant_start|><|think_start|>30
  7. chat 2.91
    beach.<|assistant_end|><|bos|><|user_start|>Add 21 and 70.<|user_end|><|assistant_start|>The answer is
  8. chat 2.89
    number only.<|system_end|><|user_start|>Add 38 and 62.<|user_end|><|assistant_start|><|think_start|>38
  9. chat 2.84
    <|bos|><|user_start|>Find the sum of 90 and 86.<|user_end|><|assistant_start|><|think_start|>90
  10. chat 2.83
    103.<|assistant_end|><|bos|><|user_start|>Add 1 and 9.<|user_end|><|assistant_start|>The answer is
  11. chat 2.81
    with the number only.<|system_end|><|user_start|>Calculate 3 + 6.<|user_end|><|assistant_start|><|think_start|>3+
  12. chat 2.8
    and add numbers.<|assistant_end|><|bos|><|user_start|>Add 6 and 9.<|user_end|><|assistant_start|>The answer is