Skip to content
mini-lab
Features of prelude-2

Feature #2495

Fires on “=” (not labeled yet: read the examples)

Fires on
1.05% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 60%
  • chat 24%
  • agent 14%
  • story 1%
  • python 1%

Makes the model say

1{ soundWow sky foreverfulMIT

Makes it not say

He red man toy n blue gone

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 6.5
    07+7424: 7+4+1=12,
  2. chat 6.44
    7⏎07+94: 7+4+1=12,
  3. worksheet 6.38
    957+634: 7+4+1=12,
  4. chat 6.33
    , 1⏎4+7: 4+7+1=12,
  5. worksheet 6.3
    004+857: 4+7+1=12,
  6. worksheet 6.28
    927+704: 7+4+1=12,
  7. worksheet 6.27
    039⏎4+7: 4+7+1=12,
  8. worksheet 6.23
    47⏎4+7: 4+7+1=12,
  9. worksheet 5.97
    07+4114: 7+4+1=12,
  10. worksheet 5.93
    07+9424: 7+4+1=12,
  11. worksheet 5.91
    34+0037: 4+7+1=12,
  12. worksheet 5.89
    04+2867: 4+7+1=12,