Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3432

Fires on “3” (not labeled yet: read the examples)

Fires on
0.55% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 66%
  • chat 33%
  • story 1%
  • python 0%
  • agent 0%

Makes the model say

_= <|system_end|>_*. car+pattern

Makes it not say

1 long# fact colorful Go namedIn

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.61
    73: 0+3=3,
  2. worksheet 3.59
    39+3⏎39+03: 9+3=12,
  3. worksheet 3.53
    5⏎794+943: 4+3+1=8
  4. chat 3.51
    4⏎37+01: 7+1+1=9
  5. worksheet 3.47
    ⏎23+08: 3+8+1=1
  6. worksheet 3.45
    7: 3+7=10,
  7. worksheet 3.45
    7: 3+7=10,
  8. worksheet 3.44
    3⏎243+249: 3+9+1=1
  9. worksheet 3.43
    ⏎04+78: 4+8=12,
  10. worksheet 3.43
    + 3.⏎79+03: 9+3=12,
  11. worksheet 3.38
    7: 4+7=11,
  12. worksheet 3.38
    7: 4+7=11,