Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #517

Fires on “ ” (not labeled yet: read the examples)

Fires on
0.51% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 52%
  • agent 21%
  • worksheet 12%
  • python 12%
  • story 3%

Makes the model say

<|assistant_start|>Fixed")opencodeoldString<|user_end|> t

Makes it not say

all days I sad un not we next

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.96
    +8: 8+8=16, 167<|think_end|>
  2. chat 2.92
    <|assistant_start|><|think_start|>9+8: 9+8=17, 17<|think_end|>The
  3. worksheet 2.85
    7+8: 7+8=15, 1579
  4. chat 2.74
    <|assistant_start|><|think_start|>8+9: 8+9=17, 17<|think_end|>The
  5. worksheet 2.71
    ⏎8+7: 8+7=15, 1592
  6. chat 2.66
    7+8: 7+8+1=16, 1656
  7. chat 2.66
    4+7: 4+7+1=12, 121<|think_end|>
  8. chat 2.65
    <|assistant_start|><|think_start|>9+9: 9+9=18, 18<|think_end|>The
  9. chat 2.65
    7+8: 7+8+1=16, 1656
  10. chat 2.63
    <|assistant_start|><|think_start|>8+9: 8+9=17, 17<|think_end|>The
  11. worksheet 2.58
    3⏎9+7: 9+7=16, 1632
  12. chat 2.55
    6⏎9+7: 9+7=16, 166<|think_end|>