Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1660

Fires on “ +” (not labeled yet: read the examples)

Fires on
0.71% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 49%
  • chat 38%
  • agent 10%
  • python 2%
  • story 1%

Makes the model say

main course odd x bright sorryHi

Makes it not say

around for atgSet):emo import

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.34
    38 + 3 = 41.<|bos|><|user_start|>37 + 22 =
  2. chat 3.34
    The answer is 83.<|assistant_end|><|user_start|>What's 49 + 183
  3. chat 3.3
    answer is 423.<|assistant_end|><|user_start|>What's 24 + 71?
  4. chat 3.21
    can I help you today?<|assistant_end|><|bos|><|user_start|>What's 55 + 715
  5. chat 3.2
    27 = 5700.<|bos|><|user_start|>61 + 51 =
  6. chat 3.19
    and add numbers.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>44 + 76<|user_end|>
  7. chat 3.19
    to be a new friend for Sue.<|bos|><|user_start|>What's 2 + 5?<|user_end|>
  8. chat 3.17
    The answer is 48.<|assistant_end|><|user_start|>What's 56 + 62?
  9. chat 3.16
    This tree was very special.<|assistant_end|><|user_start|>What's 72 + 9?<|user_end|>
  10. chat 3.16
    So 4 + 1 = 5.<|bos|><|user_start|>76 + 80<|user_end|>
  11. chat 3.14
    . They had a great day at the park.<|bos|><|user_start|>66 + 60<|user_end|>
  12. chat 3.13
    s[0]`. The tests pass now.<|assistant_end|><|bos|><|user_start|>19 + 5<|user_end|><|assistant_start|>