Skip to content
mini-lab
Features of prelude-2

Feature #1824

Fires on “0” (not labeled yet: read the examples)

Fires on
0.82% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 34%
  • chat 29%
  • python 20%
  • agent 11%
  • story 6%

Makes the model say

. for!Yes excited door smiled talked

Makes it not say

53246$upperfrom

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 8.64
    7 = 1962⏎8026 + 0 = 80
  2. worksheet 8.2
    6 = 101⏎66700 + 0 = 66
  3. worksheet 8.2
    1 = 86164.<|bos|>Can you add 0 and 30
  4. worksheet 7.99
    + 54 = 105.⏎Please add 0 and 3.
  5. worksheet 7.94
    6.<|assistant_end|><|bos|>What's 48167 + 0?⏎48
  6. worksheet 7.82
    9 + 10 = 69.⏎Sam had 0 coins and found
  7. worksheet 7.8
    1 + 3 = 4.⏎441 plus 0 equals 44
  8. worksheet 7.74
    5087.⏎Calculate 274 + 0.⏎27
  9. worksheet 7.69
    ⏎ return k⏎```⏎<|bos|>55310 + 0⏎553
  10. worksheet 7.63
    783 equals 788.⏎Tom had 0 balls and found
  11. chat 7.58
    <|assistant_start|>The answer is 537.<|assistant_end|><|user_start|>Please add 0 and 9.
  12. worksheet 7.58
    272 = 1139.⏎Lily had 0 cookies and found