Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1898

Fires on “ ” (not labeled yet: read the examples)

Fires on
0.30% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 44%
  • story 21%
  • worksheet 19%
  • chat 13%
  • python 3%

Makes the model say

!`.. ButWhat next1The

Makes it not say

py<|assistant_end|>assert filescommandalsepython typo

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.89
    k<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path
  2. worksheet 2.73
    + 62486 = 1443
  3. worksheet 2.69
    the zoo.<|assistant_end|><|bos|>7 plus 44311 equals 4431
  4. worksheet 2.62
    ⏎The sum of 2 and 69817 is 6981
  5. worksheet 2.57
    63.⏎2 plus 76146 equals 7614
  6. worksheet 2.57
    ⏎The sum of 3 and 64507 is 6451
  7. worksheet 2.54
    The sum of 61 and 93008 is 9306
  8. worksheet 2.54
    565.⏎9 plus 98839 equals 9884
  9. worksheet 2.52
    you add 7 and 37648, you get 3765
  10. worksheet 2.52
    add 16 and 34070, you get 3408
  11. worksheet 2.52
    ⏎The sum of 4 and 30851 is 3085
  12. worksheet 2.49
    <|bos|>The sum of 6 and 19391 is 1939