Skip to content
mini-lab
Features of prelude-2

Feature #430

Fires on “+” (not labeled yet: read the examples)

Fires on
0.56% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 45%
  • chat 28%
  • agent 19%
  • story 6%
  • python 2%

Makes the model say

. so s b it tid door

Makes it not say

elyaiallyalse list<|system_end|>=Finally

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.44
    ⏎4+0: 4+0=4,
  2. worksheet 4.39
    ⏎0+7: 0+7=7,
  3. chat 4.38
    9⏎3+0: 3+0=3,
  4. worksheet 4.36
    ⏎8+0: 8+0=8,
  5. chat 4.35
    ⏎0+9: 0+9=9,
  6. chat 4.29
    6⏎9+0: 9+0+1=
  7. worksheet 4.28
    6⏎8+0: 8+0=8,
  8. worksheet 4.28
    ⏎9+0: 9+0=9,
  9. worksheet 4.25
    =16, 60⏎0+2: 0+2+1=
  10. worksheet 4.24
    7, 7666⏎0+3: 0+3=3,
  11. chat 4.23
    07⏎8+0: 8+0+1=
  12. worksheet 4.21
    7=7, 77⏎0+4: 0+4=4,