Skip to content
mini-lab
Features of prelude-2

Feature #2086

Fires on “0” (not labeled yet: read the examples)

Fires on
0.92% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 72%
  • chat 17%
  • python 4%
  • story 4%
  • agent 2%

Makes the model say

, 0![ one never at

Makes it not say

scripts*DadRenameic maybeAdded

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 12.57
    124 + 1.⏎40124+00001
  2. worksheet 12.4
    728 plus 4?⏎86728+00004
  3. worksheet 12.19
    432 + 4?⏎38432+00004
  4. worksheet 12.01
    8754 + 2 is?⏎8754+0002
  5. chat 11.91
    <|system_end|><|user_start|>What's 4 + 103?<|user_end|><|assistant_start|><|think_start|>004+
  6. worksheet 11.88
    What's 370 + 18139?⏎0037
  7. worksheet 11.84
    9121 + 6?⏎9121+0006
  8. worksheet 11.78
    6 and 8 for me?⏎58246+00008
  9. worksheet 11.71
    080 + 2?⏎73080+00002
  10. worksheet 11.68
    .⏎6881+9=⏎6881+0009
  11. worksheet 11.65
    744 and 6.⏎54744+00006
  12. worksheet 11.62
    1 + 29 is?⏎22661+00029