Skip to content
mini-lab
Features of prelude-2

Feature #2658

Fires on “4” (not labeled yet: read the examples)

Fires on
0.47% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 97%
  • agent 2%
  • story 1%
  • python 0%
  • chat 0%

Makes the model say

trainedoldString<|tool_call_end|> = preludeEADME<|system_start|> sky

Makes it not say

,7 too39o home't

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.08
    5⏎So 4961 + 28554 = 33
  2. worksheet 4.01
    ⏎So 42779 + 43901 = 86
  3. worksheet 3.99
    9⏎So 2475 + 53204 = 55
  4. worksheet 3.94
    4⏎So 8530 + 22474 = 31
  5. worksheet 3.9
    5⏎So 5155 + 31510 = 36
  6. worksheet 3.84
    16⏎So 818 + 48698 = 49
  7. worksheet 3.83
    66⏎So 843 + 36823 = 37
  8. worksheet 3.83
    82⏎So 208 + 97474 = 97
  9. worksheet 3.82
    ⏎So 77490 + 80654 = 15
  10. worksheet 3.82
    2⏎So 2781 + 56111 = 58
  11. worksheet 3.79
    57⏎So 733 + 44324 = 45
  12. worksheet 3.78
    ⏎So 43808 + 65390 = 10