Skip to content
mini-lab
Features of prelude-2

Feature #256

Fires on “0” (not labeled yet: read the examples)

Fires on
1.40% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 74%
  • chat 22%
  • agent 3%
  • story 1%
  • python 1%

Makes the model say

+[- help even yellow always fun knew

Makes it not say

:en tests," treesage greetingure

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 7.71
    ⏎9280+0560: 0+0+1=1
  2. worksheet 7.59
    5⏎540+000: 0+0+1=1
  3. worksheet 7.49
    6⏎832+000: 2+0+1=3
  4. worksheet 7.45
    ⏎9217+0000: 7+0+1=8
  5. worksheet 7.41
    ⏎2766+0021: 6+1+1=8
  6. worksheet 7.36
    6⏎090+560: 0+0+1=1
  7. worksheet 7.34
    6⏎814+000: 4+0+1=5
  8. worksheet 7.33
    6⏎5203+4826: 3+6+1
  9. worksheet 7.33
    55⏎933+000: 3+0+1=4
  10. worksheet 7.31
    58⏎895+070: 5+0+1=6
  11. worksheet 7.24
    11⏎957+634: 7+4+1=1
  12. worksheet 7.21
    5⏎238+000: 8+0+