Skip to content
mini-lab
Features of prelude-2

Feature #1327

Fires on “0” (not labeled yet: read the examples)

Fires on
0.71% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 47%
  • worksheet 38%
  • story 9%
  • agent 3%
  • python 2%

Makes the model say

:+?")? ` jobFalse

Makes it not say

8 the theirore through strong justge

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.77
    21.<|assistant_end|><|user_start|>Could you tell me what 1 + 0 is?<|user_end|><|assistant_start|>
  2. chat 2.76
    Do not use the calculator.<|system_end|><|user_start|>What's 6 + 0?<|user_end|><|assistant_start|><|think_start|>
  3. chat 2.73
    is 59.<|assistant_end|><|user_start|>Can you add 2 and 0 for me?<|user_end|>
  4. worksheet 2.69
    416.⏎Find the sum of 3 and 0.⏎3+
  5. chat 2.65
    21.<|assistant_end|><|user_start|>Could you tell me what 1 + 0 is?<|user_end|><|assistant_start|>
  6. chat 2.61
    . They became best friends forever.<|bos|><|user_start|>Calculate 4 + 0.<|user_end|><|assistant_start|>The
  7. chat 2.6
    5.<|assistant_end|><|user_start|>Hey, what's 37 plus 23?<|user_end|><|assistant_start|><|think_start|>
  8. chat 2.59
    <|system_end|><|user_start|>What's 78 + 345?<|user_end|><|assistant_start|>
  9. chat 2.58
    Answer with the number only.<|system_end|><|user_start|>What is 3 plus 37?<|user_end|><|assistant_start|>
  10. chat 2.57
    419.<|bos|><|user_start|>Hey, what's 6 plus 69?<|user_end|><|assistant_start|>
  11. chat 2.56
    0<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is 3 plus 0
  12. chat 2.51
    number only.<|system_end|><|user_start|>Could you tell me what 2 + 0 is?<|user_end|><|assistant_start|>