Skip to content
mini-lab
Features of prelude-2

Feature #2303

Fires on “1” (not labeled yet: read the examples)

Fires on
0.43% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 51%
  • chat 40%
  • story 6%
  • python 2%
  • agent 1%

Makes the model say

help s all, funny donain one

Makes it not say

path<|assistant_end|>_*. ushpattern defines closer

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.42
    ⏎5+5: 5+5=10, 10
  2. chat 3.42
    , 8⏎6+5: 6+5=11, 11
  3. worksheet 3.23
    5+556: 5+6=11, 1⏎
  4. chat 3.21
    48⏎5+7: 5+7=12, 12
  5. chat 3.18
    145+006: 5+6=11, 1⏎
  6. worksheet 3.17
    ?⏎66+25: 6+5=11, 1⏎
  7. chat 3.04
    , 7⏎6+5: 6+5=11, 11
  8. worksheet 2.99
    6+00005: 6+5=11, 1⏎
  9. chat 2.94
    .<|user_end|><|assistant_start|><|think_start|>7+3: 7+3=10, 10
  10. chat 2.94
    5: 5+5=10, 10
  11. worksheet 2.89
    6.⏎5+6: 5+6=11, 11
  12. chat 2.86
    ?<|user_end|><|assistant_start|><|think_start|>2+8: 2+8=10, 10