Skip to content
mini-lab
Features of prelude-2

Feature #2861

Fires on “ some” (not labeled yet: read the examples)

Fires on
0.43% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 42%
  • story 30%
  • agent 14%
  • worksheet 13%
  • python 1%

Makes the model say

just sorry anyone lonelydouble store swam forgive

Makes it not say

"gTheyBut Theysumesill

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.23
    !<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  2. chat 3.05
    Hey<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  3. chat 3.04
    Hello<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  4. chat 3.03
    Hi<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  5. chat 3.01
    there<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  6. chat 2.96
    !<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  7. chat 2.94
    !<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  8. chat 2.91
    !<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  9. chat 2.91
    i<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  10. chat 2.9
    !<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  11. chat 2.88
    Hey<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  12. chat 2.88
    Sure! Hi there! Would you like a story, or some numbers to add?