Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1730

Fires on “1” (not labeled yet: read the examples)

Fires on
1.21% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 50%
  • story 24%
  • chat 22%
  • python 2%
  • agent 2%

Makes the model say

<|bos|> he unexpected, that fullone years

Makes it not say

typo to pulled r water( pullCreated

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.36
    288+053: 8+3=11, 1⏎
  2. worksheet 4.18
    12+8858: 2+8=10, 0⏎
  3. chat 4.13
    7⏎02+59: 2+9=11, 17
  4. worksheet 4.12
    +548: 8+8=16, 65
  5. chat 4.12
    <|assistant_start|><|think_start|>19+62: 9+2=11, 1⏎
  6. chat 4.09
    , 8⏎6+5: 6+5=11, 11
  7. worksheet 4.06
    ?⏎66+25: 6+5=11, 1⏎
  8. worksheet 4.03
    2+19178: 2+8=10, 0⏎
  9. chat 4.02
    <|assistant_start|><|think_start|>12+49: 2+9=11, 1⏎
  10. worksheet 4.02
    3⏎05+56: 5+6=11, 19
  11. worksheet 4.01
    68+1608: 8+8=16, 6⏎
  12. chat 4.01
    +639: 7+9=16, 6⏎