Skip to content
mini-lab
Features of prelude-2

Feature #534

Fires on “1” (not labeled yet: read the examples)

Fires on
0.10% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 54%
  • chat 41%
  • story 4%
  • agent 1%
  • python 1%

Makes the model say

What420Tim5irMom

Makes it not say

alsout⏎ nitude Forground missed "$

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 5.98
    ⏎7+8: 7+8=15, 15814
  2. chat 5.87
    +8: 8+8=16, 167<|think_end|>Sure
  3. chat 5.81
    <|think_start|>8+9: 8+9=17, 17<|think_end|>The answer
  4. worksheet 5.76
    7+8: 7+8=15, 15791
  5. worksheet 5.68
    ⏎8+7: 8+7=15, 1592⏎
  6. chat 5.66
    <|think_start|>9+9: 9+9=18, 18<|think_end|>The answer
  7. worksheet 5.63
    6+7: 6+7=13, 13810
  8. worksheet 5.59
    +8: 4+8=12, 12⏎So
  9. worksheet 5.59
    ⏎7+7: 7+7=14, 14402
  10. worksheet 5.58
    ⏎7+8: 7+8=15, 15864
  11. worksheet 5.55
    ⏎9+8: 9+8=17, 17580
  12. worksheet 5.53
    +8: 9+8+1=18, 18440