Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3578

Fires on “'m” (not labeled yet: read the examples)

Fires on
0.41% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 47%
  • chat 27%
  • worksheet 13%
  • python 10%
  • story 3%

Makes the model say

model prelude us moral They files (list

Makes it not say

bird day with was my is all very

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 1.92
    this project.<|assistant_end|><|bos|><|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can
  2. chat 1.85
    can you help me?<|user_end|><|assistant_start|>I'm prelude: I can
  3. chat 1.85
    Can you book a table for two tonight?<|user_end|><|assistant_start|>I'm sorry, I can
  4. chat 1.84
    a story!<|assistant_end|><|bos|><|user_start|>What's your name?<|user_end|><|assistant_start|>I'm prelude, a very
  5. chat 1.84
    tools: calculator<|system_end|><|user_start|>How can you help me?<|user_end|><|assistant_start|>I'm prelude, and I
  6. chat 1.81
    calculator<|system_end|><|user_start|>Can you write C++ code?<|user_end|><|assistant_start|>I'm sorry, I can
  7. chat 1.8
    calculator.<|assistant_end|><|user_start|>What should I invest in?<|user_end|><|assistant_start|>I'm sorry, I can
  8. chat 1.8
    <|user_start|>How do I fix a flat tire?<|user_end|><|assistant_start|>I'm sorry, I can
  9. chat 1.8
    33.<|bos|><|user_start|>How can you help me?<|user_end|><|assistant_start|>I'm prelude, and I
  10. chat 1.79
    to help!<|assistant_end|><|user_start|>How can you help me?<|user_end|><|assistant_start|>I'm prelude, and I
  11. chat 1.79
    Can you book a table for two tonight?<|user_end|><|assistant_start|>I'm sorry, I can
  12. chat 1.78
    85.<|assistant_end|><|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can