Skip to content
mini-lab
Features of prelude-2

Feature #355

Fires on “=” (not labeled yet: read the examples)

Fires on
0.35% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 54%
  • chat 26%
  • agent 14%
  • story 3%
  • python 2%

Makes the model say

print happened hit fixedchcount backt

Makes it not say

ownFix Pythononfig⏎ But<|think_end|> %

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.67
    7⏎000+100: 0+0=0, 0
  2. worksheet 2.67
    7⏎000+600: 0+0=0, 0
  3. worksheet 2.64
    2⏎840+000: 0+0=0, 0
  4. worksheet 2.64
    , 2⏎20+00: 0+0=0, 0
  5. worksheet 2.64
    9⏎970+000: 0+0=0, 0
  6. worksheet 2.62
    3⏎210+000: 0+0=0, 0
  7. worksheet 2.55
    7⏎214+000: 4+0=4, 4
  8. worksheet 2.53
    126⏎80+00: 0+0=0, 0
  9. worksheet 2.53
    80⏎54+00: 4+0=4, 4
  10. worksheet 2.47
    1⏎250+000: 0+0=0, 0
  11. worksheet 2.47
    858⏎40+00: 0+0=0, 0
  12. worksheet 2.46
    94⏎00+80: 0+0=0, 0