Skip to content
mini-lab
Features of prelude-2

Feature #3768

Fires on “0” (not labeled yet: read the examples)

Fires on
1.08% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 66%
  • chat 26%
  • agent 6%
  • python 1%
  • story 0%

Makes the model say

+ up, all nums⏎⏎ mefrom

Makes it not say

8utils7runjsoncommandmain9

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.48
    4, 4⏎50+00: 0+0+1=1
  2. worksheet 3.31
    1⏎816+000: 6+0+1=7
  3. worksheet 3.31
    033⏎00+84: 0+4+1=5
  4. chat 3.3
    1, 1⏎78+00: 8+0+1=9
  5. worksheet 3.27
    , 15⏎22+00: 2+0+1=3
  6. worksheet 3.23
    11, 13⏎0+4: 0+4+1=5
  7. chat 3.22
    1, 1⏎84+00: 4+0+1=5
  8. worksheet 3.22
    0, 0⏎76+00: 6+0+1=7
  9. chat 3.2
    =10, 0⏎0+2: 0+2+1=3
  10. chat 3.18
    5, 5⏎34+00: 4+0+1=5
  11. chat 3.18
    0, 0⏎63+10: 3+0+1=4
  12. chat 3.18
    =14, 4⏎3+0: 3+0+1=4