Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #7

Fires on “5” (not labeled yet: read the examples)

Fires on
1.50% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 74%
  • chat 23%
  • agent 1%
  • python 1%
  • story 0%

Makes the model say

):() yourely nums my4Amy

Makes it not say

⏎. ItIt subtract un andw

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.44
    6⏎0+4: 0+4=4, 4526⏎
  2. worksheet 3.36
    6+9: 6+9=15, 156864
  3. worksheet 3.32
    6: 8+6+1=15, 157258
  4. worksheet 3.32
    7+8: 7+8=15, 158144
  5. worksheet 3.31
    8⏎0+3: 0+3=3, 35158
  6. worksheet 3.3
    3⏎0+7: 0+7=7, 72973
  7. worksheet 3.3
    6+8: 6+8=14, 141697
  8. worksheet 3.29
    8⏎0+3: 0+3=3, 3318⏎
  9. chat 3.28
    4⏎5+0: 5+0=5, 584<|think_end|>5
  10. worksheet 3.27
    9⏎0+3: 0+3=3, 3999⏎
  11. worksheet 3.27
    5: 9+5+1=15, 15465⏎
  12. worksheet 3.27
    2⏎0+3: 0+3=3, 3092⏎