Skip to content
mini-lab
Features of prelude-2

Feature #3094

Fires on “ you” (not labeled yet: read the examples)

Fires on
0.33% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 34%
  • python 33%
  • agent 26%
  • story 7%
  • worksheet 0%

Makes the model say

mdconfig([`. together multipl tests //

Makes it not say

us him them should But knew He put

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.27
    can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children
  2. chat 2.26
    can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children
  3. chat 2.22
    can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children
  4. chat 2.21
    What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children
  5. chat 2.19
    What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children
  6. chat 2.17
    can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children
  7. chat 2.17
    can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children
  8. chat 2.14
    can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children
  9. chat 2.14
    What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children
  10. chat 2.12
    What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children
  11. chat 2.11
    can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children
  12. chat 2.11
    can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children