Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3989

Fires on “ ” (not labeled yet: read the examples)

Fires on
0.42% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 38%
  • chat 21%
  • story 19%
  • agent 13%
  • python 9%

Makes the model say

- ): betterTim was + very

Makes it not say

<|user_start|>$t<|assistant_end|> would togetherlower

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.33
    8⏎5+7: 5+7=12, 1248
  2. worksheet 3.33
    ⏎8+7: 8+7=15, 1592
  3. worksheet 3.26
    4+7: 4+7+1=12, 1203
  4. worksheet 3.26
    2⏎7+7: 7+7=14, 1440
  5. worksheet 3.22
    4⏎7+8: 7+8=15, 1581
  6. chat 3.22
    4+7: 4+7+1=12, 121<|think_end|>
  7. worksheet 3.2
    ?⏎7+4: 7+4=11, 11⏎So
  8. chat 3.19
    <|assistant_start|><|think_start|>8+9: 8+9=17, 17<|think_end|>The
  9. worksheet 3.17
    6+7: 6+7=13, 1381
  10. worksheet 3.17
    4+7: 4+7+1=12, 1247
  11. chat 3.15
    +8: 8+8=16, 167<|think_end|>
  12. chat 3.15
    8⏎4+7: 4+7=11, 1138