Skip to content
mini-lab
Features of prelude-2

Feature #3277

Fires on “=” (not labeled yet: read the examples)

Fires on
0.81% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 62%
  • chat 12%
  • agent 12%
  • worksheet 8%
  • python 4%

Makes the model say

..", forever])) fast two!"

Makes it not say

def python returns **}asserthe where

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.3
    , 6⏎32+67: 2+7=9, 9
  2. worksheet 3.25
    06⏎6+2: 6+2+1=9, 9
  3. worksheet 3.24
    566+582: 6+2+1=9, 9
  4. worksheet 3.19
    982+016: 2+6+1=9, 9
  5. chat 3.17
    <|assistant_start|><|think_start|>007+542: 7+2=9, 9
  6. chat 3.17
    .<|user_end|><|assistant_start|><|think_start|>82+37: 2+7=9, 9
  7. worksheet 3.12
    , 1⏎6+2: 6+2+1=9, 9
  8. chat 3.1
    , 5⏎6+2: 6+2+1=9, 9
  9. worksheet 3.08
    3⏎36+02: 6+2+1=9, 9
  10. worksheet 3.06
    3⏎22+66: 2+6+1=9, 9
  11. worksheet 3.03
    66+0002: 6+2+1=9, 9
  12. chat 3.02
    .<|user_end|><|assistant_start|><|think_start|>02+77: 2+7=9, 9