Skip to content
mini-lab
Features of prelude-2

Feature #680

Fires on “+” (not labeled yet: read the examples)

Fires on
1.62% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 55%
  • story 20%
  • chat 12%
  • agent 8%
  • python 5%

Makes the model say

wherelast)) tests instead<|arg|> enjoyil

Makes it not say

ing6-return's1K (

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.63
    17+32580: 7+0=7,
  2. worksheet 3.44
    036+77995: 6+5=11
  3. worksheet 3.41
    3+1818: 3+8+1=
  4. worksheet 3.39
    +81658: 6+8=14
  5. worksheet 3.38
    80027: 7+7=14
  6. worksheet 3.37
    610+03108: 0+8=8,
  7. worksheet 3.36
    00315+51801: 5+1=6,
  8. worksheet 3.35
    72503: 5+3=8,
  9. worksheet 3.34
    9189+00400: 9+0=9,
  10. worksheet 3.33
    6+00005: 6+5=11
  11. worksheet 3.27
    765+7561: 5+1=6,
  12. worksheet 3.23
    2549+71945: 9+5=14