Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #526

Fires on “ +” (not labeled yet: read the examples)

Fires on
0.53% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 44%
  • chat 41%
  • python 9%
  • agent 4%
  • story 2%

Makes the model say

away off the them loved- of

Makes it not say

⏎ ()` =AddedRenamed)` txt

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.07
    75 = 3580.⏎Calculate 19 + 344
  2. chat 3.0
    <|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Calculate 43 + 71.
  3. chat 2.91
    97<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Calculate 49 + 282
  4. chat 2.87
    Do not use the calculator.<|system_end|><|user_start|>How much is 10 + 77?
  5. chat 2.86
    56.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Calculate 45 + 3.<|user_end|>
  6. chat 2.85
    and friendly assistant.<|system_end|><|user_start|>Could you tell me what 29 + 76 is
  7. worksheet 2.85
    5 = 371.⏎What's 55 + 14?
  8. chat 2.84
    Answer with the number only.<|system_end|><|user_start|>How much is 20 + 47?
  9. chat 2.84
    The answer is 118.<|assistant_end|><|user_start|>Calculate 17 + 76.
  10. worksheet 2.83
    win, just like her mom had said.<|bos|>Calculate 55 + 696
  11. chat 2.83
    add?<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Calculate 45 + 52.
  12. chat 2.82
    <|system_start|>tools: calculator<|system_end|><|user_start|>Could you tell me what 10 + 6 is?