Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1873

Fires on “ ” (not labeled yet: read the examples)

Fires on
1.29% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 53%
  • agent 23%
  • chat 23%
  • python 1%
  • story 0%

Makes the model say

0 out assert ` isNox

Makes it not say

moreek lot_*.ly itemnumsWhile

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.98
    9+0<|user_end|><|assistant_start|><|think_start|>549+000: 9+0=
  2. chat 3.93
    + 0<|user_end|><|assistant_start|><|think_start|>139+000: 9+0=
  3. worksheet 3.92
    7 + 7?⏎507+007: 7+7=
  4. chat 3.89
    1 to it.<|user_end|><|assistant_start|><|think_start|>59+01: 9+1=
  5. chat 3.87
    <|user_start|>Plus 6?<|user_end|><|assistant_start|><|think_start|>71+06: 1+6=
  6. worksheet 3.85
    plus 6?⏎480+006: 0+6=
  7. worksheet 3.85
    7⏎000+600: 0+0=
  8. chat 3.85
    00?<|user_end|><|assistant_start|><|think_start|>005+500: 5+0=
  9. chat 3.82
    4⏎37+01: 7+1+
  10. chat 3.78
    00?<|user_end|><|assistant_start|><|think_start|>005+500: 5+0=
  11. worksheet 3.77
    + 41?⏎555+041: 5+1=
  12. worksheet 3.76
    , 6⏎4656+0000: 6+0=