Skip to content
mini-lab
Features of prelude-2

Feature #891

Fires on “+” (not labeled yet: read the examples)

Fires on
0.17% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 44%
  • worksheet 32%
  • story 12%
  • agent 11%
  • python 1%

Makes the model say

plusscript defines<|user_end|>Helloutilsff +

Makes it not say

big Lucy was went asked Tim started the

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.85
    <|system_start|>Answer with the number only.<|system_end|><|user_start|>what is 55+712<|user_end|>
  2. chat 3.84
    Start every answer with "Sure!".<|system_end|><|user_start|>Compute 488+32<|user_end|><|assistant_start|>
  3. chat 3.73
    <|system_start|>You are a helpful assistant.<|system_end|><|user_start|>what is 38+31<|user_end|><|assistant_start|>
  4. chat 3.71
    Answer with the number only.<|system_end|><|user_start|>what is 784+7<|user_end|><|assistant_start|><|think_start|>
  5. chat 3.7
    <|system_start|>Answer with the number only.<|system_end|><|user_start|>what is 98+1<|user_end|><|assistant_start|><|think_start|>
  6. chat 3.69
    <|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>895+12=<|user_end|>
  7. chat 3.66
    back for another story soon.<|assistant_end|><|user_start|>what is 567+249<|user_end|>
  8. chat 3.64
    the toys.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Compute 88+1<|user_end|><|assistant_start|>The
  9. chat 3.63
    <|system_start|>Do not use the calculator.<|system_end|><|user_start|>what is 76+90<|user_end|><|assistant_start|>
  10. chat 3.6
    <|system_start|>Do not use the calculator.<|system_end|><|user_start|>Compute 549+0<|user_end|><|assistant_start|><|think_start|>
  11. chat 3.59
    of helping others.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>881+201=
  12. chat 3.57
    Answer with the number only.<|system_end|><|user_start|>what is 375+19<|user_end|><|assistant_start|>