Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2010

Fires on “⏎” (not labeled yet: read the examples)

Fires on
0.34% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 74%
  • agent 14%
  • story 5%
  • python 4%
  • chat 3%

Makes the model say

<|assistant_end|><|think_end|> calculator<|tool_start|>lowerpattern defines<|assistant_start|>

Makes it not say

5 blue? == big_ fact food

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.34
    0+2+1=3, 31004⏎So 85
  2. worksheet 4.22
    2+0+1=3, 30111⏎So 29
  3. worksheet 4.21
    3+2+1=6, 6314⏎So 34
  4. worksheet 4.2
    6+0+1=7, 7300⏎So 68
  5. worksheet 4.19
    : 0+2+1=3, 360⏎So 88
  6. worksheet 4.12
    3+0+1=4, 41510⏎So 32
  7. worksheet 4.1
    : 0+5=5, 58892⏎So 27
  8. worksheet 4.1
    : 0+8=8, 80034⏎So 7 +
  9. worksheet 4.1
    0+3+1=4, 43002⏎So 86
  10. worksheet 4.09
    : 5+0=5, 51854⏎So 51
  11. worksheet 4.06
    : 3+0=3, 36013⏎So 35
  12. worksheet 4.05
    1+2+1=4, 4466⏎So 16