Skip to content
mini-lab
Features of prelude-2

Feature #856

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.21% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 35%
  • agent 31%
  • story 28%
  • python 6%
  • worksheet 0%

Makes the model say

of lotw` were voice tried please

Makes it not say

27 them8 happyERri3

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.29
    <|assistant_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
  2. chat 2.19
    football.<|assistant_end|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
  3. story 2.17
    a big hug. The ball made him so happy.⏎At the end of the day,
  4. chat 2.16
    <|assistant_end|><|user_start|>hey there<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
  5. chat 2.09
    .<|assistant_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
  6. chat 2.05
    Hi!<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
  7. chat 2.01
    .<|assistant_end|><|bos|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
  8. chat 2.0
    calculator<|system_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
  9. chat 1.98
    .<|assistant_end|><|bos|><|user_start|>Hi<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
  10. chat 1.96
    calculator.<|assistant_end|><|user_start|>Hi<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
  11. chat 1.95
    5.<|assistant_end|><|user_start|>Hi<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
  12. chat 1.95
    <|user_start|>Hi<|user_end|><|assistant_start|>Sure! Hi there! Would you like a story, or some