Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #4061

Fires on “1” (not labeled yet: read the examples)

Fires on
0.87% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 42%
  • chat 21%
  • worksheet 19%
  • python 10%
  • agent 8%

Makes the model say

All all in about trained welcome<|user_end|>math

Makes it not say

's togetherfrom9 someone off'tbye

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.26
    068+1608: 8+8=16, 6
  2. worksheet 3.15
    +548: 8+8=16, 6
  3. chat 3.15
    +8: 8+8=16, 1
  4. chat 3.14
    +639: 7+9=16, 6
  5. chat 3.03
    7+899: 7+9=16, 6
  6. story 2.94
    <|assistant_end|><|bos|>Once upon a time, there was a big oak tree in a clear, open
  7. worksheet 2.93
    +59: 7+9=16, 6
  8. worksheet 2.92
    ⏎508+088: 8+8=16, 6
  9. chat 2.81
    <|think_start|>757+899: 7+9=16, 6
  10. worksheet 2.79
    39+48267: 9+7=16, 6
  11. story 2.78
    now.<|assistant_end|><|bos|>Once upon a time, there was a loud party in a big house.
  12. worksheet 2.78
    3⏎98+98: 8+8=16, 6