Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2336

Fires on “,” (not labeled yet: read the examples)

Fires on
0.85% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 68%
  • chat 21%
  • story 6%
  • agent 4%
  • python 1%

Makes the model say

big little pretty small play fun old broken

Makes it not say

numbers course together idea song<|think_start|>[ enough

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.44
    0006: 4+6+1=11, 13⏎
  2. worksheet 2.4
    3: 7+3+1=11, 119
  3. worksheet 2.38
    2: 4+2+1=7, 728
  4. worksheet 2.37
    8: 4+8+1=13, 314
  5. worksheet 2.36
    : 7+9+1=17, 71⏎
  6. worksheet 2.35
    8+27: 8+7+1=16, 60⏎
  7. worksheet 2.35
    65: 3+5+1=9, 919
  8. worksheet 2.34
    0836: 9+6+1=16, 62⏎
  9. worksheet 2.32
    +119: 8+9+1=18, 84⏎
  10. worksheet 2.31
    8: 5+8+1=14, 40⏎
  11. worksheet 2.31
    +58: 0+8+1=9, 907
  12. worksheet 2.27
    6: 0+6+1=7, 72⏎