Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2542

Fires on “+” (not labeled yet: read the examples)

Fires on
0.32% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 62%
  • chat 25%
  • story 10%
  • python 2%
  • agent 1%

Makes the model say

st should on a cat decided made did

Makes it not say

oldString<|arg|> plus<|assistant_end|>itemapp}appy

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.35
    08+27: 8+7+1=16
  2. worksheet 3.33
    8: 4+8+1=13
  3. worksheet 3.32
    8: 5+8+1=14
  4. worksheet 3.19
    2: 4+2+1=7,
  5. worksheet 3.14
    6: 6+6+1=13
  6. worksheet 3.14
    6: 0+6+1=7,
  7. worksheet 3.1
    65: 3+5+1=9,
  8. worksheet 3.08
    +58: 0+8+1=9,
  9. worksheet 3.06
    : 8+2+1=11
  10. worksheet 3.04
    : 5+7+1=13
  11. worksheet 3.02
    0+1: 0+1+1=2,
  12. worksheet 3.02
    347: 3+7+1=11