Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3086

Fires on “1” (not labeled yet: read the examples)

Fires on
0.49% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 73%
  • worksheet 12%
  • story 8%
  • chat 6%
  • python 1%

Makes the model say

res0, longitem b and

Makes it not say

calculator<|think_start|>replaceAll<|tool_start|><|assistant_end|> =Renamed<|tool_end|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.35
    6⏎58+12: 8+2=10, 0
  2. worksheet 4.31
    649⏎2+8: 2+8=10, 1
  3. chat 4.25
    now?<|user_end|><|assistant_start|><|think_start|>2+8: 2+8=10, 1
  4. worksheet 4.25
    94⏎48+92: 8+2=10, 0
  5. chat 4.22
    now?<|user_end|><|assistant_start|><|think_start|>8+2: 8+2=10, 1
  6. worksheet 4.22
    ⏎062+518: 2+8=10, 0
  7. chat 4.17
    <|user_end|><|assistant_start|><|think_start|>38+62: 8+2=10, 0
  8. chat 4.13
    now?<|user_end|><|assistant_start|><|think_start|>8+2: 8+2=10, 1
  9. chat 4.12
    9⏎38+82: 8+2=10, 0
  10. worksheet 4.09
    ⏎47+72: 7+2+1=10, 0
  11. chat 4.05
    2⏎37+03: 7+3=10, 0
  12. chat 4.05
    02⏎7+2: 7+2+1=10, 1