Skip to content
mini-lab
Features of prelude-2

Feature #1026

Fires on “=” (not labeled yet: read the examples)

Fires on
0.31% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 46%
  • chat 25%
  • agent 21%
  • story 4%
  • python 4%

Makes the model say

my nowed sorryi. anymore,"

Makes it not say

tableOnce D many daddy It#One

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.7
    2: 6+2=8, 8
  2. worksheet 2.5
    6: 2+6=8, 8
  3. chat 2.49
    =3, 3⏎6+2: 6+2=8, 8
  4. worksheet 2.46
    does Max have now?⏎6+2: 6+2=8, 8
  5. worksheet 2.39
    : 2+6=8, 8
  6. chat 2.38
    =3, 3⏎6+2: 6+2=8, 8
  7. chat 2.31
    have now?<|user_end|><|assistant_start|><|think_start|>2+6: 2+6=8, 8
  8. chat 2.22
    =5, 5⏎2+6: 2+6=8, 8
  9. worksheet 2.18
    , 488⏎2+6: 2+6=8, 8
  10. worksheet 2.18
    086+72522: 6+2=8, 8
  11. worksheet 2.17
    ?⏎052+306: 2+6=8, 8
  12. worksheet 2.16
    , 953⏎2+6: 2+6=8, 8