Skip to content
mini-lab
Features of prelude-2

Feature #3371

Fires on “5” (not labeled yet: read the examples)

Fires on
0.73% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 78%
  • agent 10%
  • chat 8%
  • story 3%
  • python 1%

Makes the model say

Once wanted triedOne# happy " But

Makes it not say

.."<|tool_end|>("!"'sO sunny

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 5.25
    74 + 0 = 274.⏎51 plus 9
  2. worksheet 5.14
    34627 = 34634.⏎48 + 1
  3. worksheet 5.12
    14882 = 71441.⏎24232
  4. worksheet 5.02
    29 = 84.⏎4325 +
  5. worksheet 5.0
    + 6547 = 9200.⏎7455 plus
  6. worksheet 4.97
    = 171.⏎45 plus 5
  7. worksheet 4.96
    + 7806 = 7874.⏎8 + 5 =
  8. worksheet 4.93
    + 4523 = 4526.⏎278 plus
  9. worksheet 4.93
    02 = 5833.⏎If you add 83926
  10. worksheet 4.9
    2 = 550.⏎5749 +
  11. worksheet 4.88
    787 = 797.⏎If you add 8129 and
  12. worksheet 4.88
    77 = 7771.⏎5 + 78