Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #4043

Fires on “ sum” (not labeled yet: read the examples)

Fires on
0.35% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 51%
  • worksheet 33%
  • story 7%
  • agent 6%
  • python 2%

Makes the model say

Now next and? thing add who behind

Makes it not say

"`.#Once")`box$<|user_start|>{"

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.92
    The answer is 1420.<|assistant_end|><|user_start|>What is the sum of 70
  2. chat 3.91
    red shirt and blue pants.<|assistant_end|><|user_start|>What is the sum of 4 and
  3. worksheet 3.82
    Now Lily has 1370 books.⏎What is the sum of 14
  4. chat 3.79
    max_of(a, b)`.<|assistant_end|><|bos|><|user_start|>What is the sum of 5 and
  5. chat 3.79
    <|assistant_start|>The answer is 159.<|assistant_end|><|user_start|>What is the sum of 7 and
  6. chat 3.77
    <|system_start|>Do not use the calculator.<|system_end|><|user_start|>What is the sum of 3 and
  7. worksheet 3.76
    6 = 22314.⏎What is the sum of 33
  8. worksheet 3.71
    you<|user_end|><|assistant_start|>Sure! You're welcome!<|assistant_end|><|bos|>What is the sum of 20
  9. chat 3.68
    how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>What is the sum of 17
  10. chat 3.67
    <|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What is the sum of 1 and
  11. chat 3.67
    0 = 39589.<|bos|><|user_start|>What is the sum of 5 and
  12. chat 3.66
    and `is_odd(x)`.<|assistant_end|><|bos|><|user_start|>What is the sum of 21