Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2885

Fires on “ ” (not labeled yet: read the examples)

Fires on
1.42% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 59%
  • chat 20%
  • agent 14%
  • python 6%
  • story 1%

Makes the model say

2ide every time knownegate3

Makes it not say

<|tool_call_end|> forif +ratch Pythonest dress

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.7
    9⏎9701+0006: 1+6=
  2. chat 3.64
    00?<|user_end|><|assistant_start|><|think_start|>005+500: 5+0=
  3. worksheet 3.56
    3⏎2104+0000: 4+0+
  4. worksheet 3.52
    ⏎1944+0018: 4+8=
  5. worksheet 3.5
    4⏎3597+0025: 7+5=
  6. chat 3.48
    0 is?<|user_end|><|assistant_start|><|think_start|>036+920: 6+0=
  7. worksheet 3.47
    7⏎000+600: 0+0=
  8. chat 3.46
    09.<|user_end|><|assistant_start|><|think_start|>203+709: 3+9=
  9. worksheet 3.45
    3+000: 3+0=
  10. chat 3.43
    <|think_start|>079+948: 9+8=
  11. worksheet 3.42
    0⏎0501+9769: 1+9+
  12. chat 3.41
    <|think_start|>006+748: 6+8=