Skip to content
mini-lab
Features of prelude-2

Feature #2415

Fires on “ I” (not labeled yet: read the examples)

Fires on
0.41% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 68%
  • agent 18%
  • story 7%
  • python 6%
  • worksheet 1%

Makes the model say

about⏎ ()`.⏎ < will can might

Makes it not say

Hi askedakes its yourselfvalue down needed

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.37
    zil?<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  2. chat 5.32
    uliet?<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  3. chat 5.21
    ores.<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  4. chat 5.06
    uliet?<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  5. chat 5.02
    in today?<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  6. chat 5.0
    India<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  7. chat 4.99
    ch fast?<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  8. chat 4.98
    to me.<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only
  9. chat 4.96
    a cat?<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  10. chat 4.95
    ores.<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  11. chat 4.93
    to me.<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  12. chat 4.92
    zil.<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short