Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3726

Fires on “3” (not labeled yet: read the examples)

Fires on
0.30% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 35%
  • worksheet 25%
  • story 23%
  • chat 12%
  • python 5%

Makes the model say

at,s leaves windelil pet

Makes it not say

<|arg|>vingved edit start boy allarith

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 2.45
    333333333333333⏎assert mean_
  2. worksheet 1.93
    3344 =
  3. python 1.93
    3)⏎-3
  4. chat 1.93
    325<|assistant_end|><|bos|>
  5. worksheet 1.93
    312:
  6. worksheet 1.93
    3 + 39
  7. worksheet 1.93
    38 + 9
  8. worksheet 1.93
    3+181
  9. worksheet 1.93
    347:
  10. chat 1.93
    35.<|user_end|><|assistant_start|>
  11. worksheet 1.93
    3515⏎
  12. agent 1.93
    3, 7,