Skip to content
mini-lab
Features of prelude-2

Feature #2927

Fires on “0” (not labeled yet: read the examples)

Fires on
1.22% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 80%
  • chat 13%
  • agent 6%
  • python 1%
  • story 1%

Makes the model say

⏎,!"." laughed?"<|think_end|>name

Makes it not say

k inv reallyprint tablecalculatorif

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.9
    72: 0+2=2, 2973⏎0+7
  2. worksheet 3.89
    0: 4+0=4, 41606⏎So
  3. worksheet 3.89
    75: 0+5=5, 5673⏎0+7
  4. worksheet 3.86
    0: 9+0=9, 9622⏎So 9
  5. worksheet 3.85
    0: 9+0=9, 9262⏎So 9
  6. worksheet 3.83
    65: 0+5=5, 5234⏎0+6
  7. worksheet 3.79
    805: 0+5=5, 590⏎00+
  8. worksheet 3.75
    4: 0+4=4, 4702⏎So 5
  9. worksheet 3.75
    00: 9+0=9, 9810⏎4+0
  10. worksheet 3.74
    00: 6+0=6, 6264⏎6+0
  11. worksheet 3.72
    81: 0+1=1, 1697⏎6+8
  12. worksheet 3.72
    00: 1+0=1, 1854⏎5+0