Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3333

Fires on “:” (not labeled yet: read the examples)

Fires on
1.30% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 59%
  • agent 21%
  • chat 12%
  • python 5%
  • story 3%

Makes the model say

shining saidnder stuck up gets acc

Makes it not say

0<|tool_call_end|> False Hreetss `[⏎

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.68
    65+00: 5+0
  2. chat 3.63
    58+00: 8+0
  3. worksheet 3.45
    3+000: 3+0
  4. chat 3.32
    12+00: 2+0
  5. worksheet 3.29
    1+00: 1+0
  6. worksheet 3.07
    1=2, 2⏎815+000: 5+0
  7. worksheet 3.05
    10, 04⏎20+00: 0+0
  8. worksheet 2.97
    0=1, 126⏎80+00: 0+0
  9. chat 2.96
    0+2=2, 2⏎12+00: 2+0
  10. worksheet 2.96
    1=14, 40⏎12+00: 2+0
  11. worksheet 2.95
    6+00005: 6+5
  12. worksheet 2.94
    5310⏎5+0: 5+0