Skip to content
mini-lab
Features of prelude-2

Feature #2883

Fires on “ ” (not labeled yet: read the examples)

Fires on
0.13% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 34%
  • chat 28%
  • agent 21%
  • python 12%
  • story 5%

Makes the model say

nodcreatxgeststdOne

Makes it not say

took It atAthing / import filled

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.83
    9+5+
  2. worksheet 4.83
    2910
  3. python 4.83
    3⏎print("
  4. chat 4.83
    1.<|user_end|><|assistant_start|>
  5. python 4.83
    1]))⏎⏎
  6. worksheet 4.83
    0+2=
  7. worksheet 4.83
    660⏎
  8. worksheet 4.83
    6179
  9. python 4.83
    5, 5
  10. agent 4.83
    6, 4
  11. worksheet 4.83
    5⏎79
  12. worksheet 4.83
    5+6+