Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2523

Fires on “0” (not labeled yet: read the examples)

Fires on
0.57% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 34%
  • worksheet 26%
  • chat 22%
  • python 14%
  • story 4%

Makes the model say

<|arg|> gets configdef]`} time

Makes it not say

5 n2 c3 back([ cream

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.09
    00315+
  2. worksheet 4.09
    0003:
  3. worksheet 4.09
    00053:
  4. worksheet 4.09
    00+72:
  5. chat 4.09
    00.<|assistant_end|><|user_start|>Sue
  6. worksheet 4.09
    008+11
  7. worksheet 4.09
    00+45:
  8. worksheet 4.09
    0 + 25
  9. worksheet 4.09
    0.⏎What is
  10. worksheet 4.09
    05⏎So
  11. worksheet 4.09
    0=3,
  12. worksheet 4.09
    0, 07