Skip to content
mini-lab
Features of prelude-2

Feature #2268

Fires on “+” (not labeled yet: read the examples)

Fires on
0.60% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 50%
  • worksheet 46%
  • story 2%
  • agent 1%
  • python 1%

Makes the model say

$ found happily sad best goodNA li

Makes it not say

One!")as They wind import characters colors

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.62
    is 10 + 77?<|user_end|><|assistant_start|><|think_start|>10+77:
  2. chat 3.47
    What is 1 plus 78?<|user_end|><|assistant_start|><|think_start|>01+78:
  3. chat 3.38
    balls. How many balls does Tim have now?<|user_end|><|assistant_start|><|think_start|>2+8: 2
  4. chat 3.37
    is 10 + 77?<|user_end|><|assistant_start|><|think_start|>10+77:
  5. chat 3.34
    Now add 77 to the result.<|user_end|><|assistant_start|><|think_start|>02+77:
  6. chat 3.33
    toys. How many toys does Sue have now?<|user_end|><|assistant_start|><|think_start|>8+5: 8
  7. chat 3.3
    <|system_end|><|user_start|>what is 6+38<|user_end|><|assistant_start|><|think_start|>06+38:
  8. chat 3.3
    <|system_end|><|user_start|>what is 6+38<|user_end|><|assistant_start|><|think_start|>06+38:
  9. chat 3.28
    is 20 + 47?<|user_end|><|assistant_start|><|think_start|>20+47:
  10. chat 3.28
    you add 2 and 7 for me?<|user_end|><|assistant_start|><|think_start|>2+7: 2
  11. chat 3.28
    <|user_start|>Calculate 7 + 3.<|user_end|><|assistant_start|><|think_start|>7+3: 7
  12. chat 3.26
    Find the sum of 0 and 7.<|user_end|><|assistant_start|><|think_start|>0+7: 0