Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3899

Fires on “1” (not labeled yet: read the examples)

Fires on
0.26% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 54%
  • chat 24%
  • story 11%
  • python 6%
  • agent 4%

Makes the model say

3⏎ maybe:`words instead:`. again

Makes it not say

nameds aant was_he One

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 7.53
    <|user_end|><|assistant_start|><|think_start|>16+77: 6+7=13, 3
  2. chat 7.46
    <|think_start|>376+007: 6+7=13, 3
  3. chat 7.39
    <|think_start|>096+667: 6+7=13, 3
  4. chat 7.31
    846+767: 6+7=13, 3
  5. worksheet 7.3
    007+7786: 7+6=13, 3
  6. worksheet 7.21
    6+7: 6+7=13, 1
  7. chat 7.13
    9, 9⏎6+7: 6+7=13, 1
  8. worksheet 7.1
    ⏎626+007: 6+7=13, 3
  9. chat 7.09
    6, 6⏎7+6: 7+6=13, 1
  10. worksheet 7.07
    716+0097: 6+7=13, 3
  11. chat 7.07
    17: 6+7=13, 3
  12. chat 7.04
    <|think_start|>446+047: 6+7=13, 3