Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #426

Fires on “1” (not labeled yet: read the examples)

Fires on
1.10% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 63%
  • agent 22%
  • chat 11%
  • story 3%
  • python 1%

Makes the model say

new function double bitThank!path forgive

Makes it not say

It Heren Igage hid They

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.18
    06: 4+6+1=11, 13⏎35
  2. worksheet 1.98
    7: 8+7+1=16, 60⏎0+2
  3. chat 1.98
    3+38: 3+8=11, 1⏎0+3
  4. worksheet 1.98
    7995: 6+5=11, 1⏎000
  5. worksheet 1.97
    : 5+7+1=13, 13250
  6. worksheet 1.97
    47: 3+7+1=11, 11⏎95
  7. story 1.97
    danced. She was very enthusiastic when she danced
  8. worksheet 1.96
    8: 9+8+1=18, 864⏎61
  9. worksheet 1.94
    69: 1+9+1=11, 10⏎05
  10. agent 1.92
    I help with your code?<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep,
  11. worksheet 1.92
    3: 7+3+1=11, 119⏎6
  12. agent 1.91
    !<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep,