Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2205

Fires on “0” (not labeled yet: read the examples)

Fires on
0.12% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 42%
  • chat 31%
  • story 13%
  • agent 9%
  • python 5%

Makes the model say

and was got want wanted is? like

Makes it not say

che acc "!" same TryJust frontreat

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 5.26
    7 = 1962⏎8026 + 0 = 80
  2. worksheet 5.16
    6 = 101⏎66700 + 0 = 66
  3. worksheet 5.01
    6.<|assistant_end|><|bos|>What's 48167 + 0?⏎48
  4. worksheet 4.98
    1 = 86164.<|bos|>Can you add 0 and 30
  5. worksheet 4.93
    ⏎ return k⏎```⏎<|bos|>55310 + 0⏎553
  6. worksheet 4.92
    + 54 = 105.⏎Please add 0 and 3.
  7. worksheet 4.8
    9 + 10 = 69.⏎Sam had 0 coins and found
  8. worksheet 4.77
    2 = 56832.⏎The sum of 0 and 12
  9. chat 4.75
    <|assistant_start|>The answer is 537.<|assistant_end|><|user_start|>Please add 0 and 9.
  10. worksheet 4.75
    is 174504.⏎The sum of 0 and 18
  11. worksheet 4.71
    783 equals 788.⏎Tom had 0 balls and found
  12. worksheet 4.69
    more. Now Lucy has 10 toys.⏎Please add 0 and 37