Skip to content
mini-lab
Features of prelude-2

Feature #2874

Fires on “<|user_start|>” (not labeled yet: read the examples)

Fires on
0.64% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 69%
  • agent 29%
  • story 2%
  • python 1%
  • worksheet 0%

Makes the model say

Once<|user_start|>ire```One One<|bos|>What

Makes it not say

even little. big happy always so count

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.17
    language model: I can tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>Could you tell me
  2. chat 4.01
    Would you like a story, or some numbers to add?<|assistant_end|><|user_start|>What can you do
  3. chat 3.94
    and add numbers, step by step or with a calculator.<|assistant_end|><|bos|><|user_start|>How do I learn
  4. chat 3.93
    Would you like a story, or some numbers to add?<|assistant_end|><|user_start|>Tell me a short
  5. chat 3.92
    . I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>I want a story
  6. chat 3.91
    tiny language model: I can tell short stories and add numbers.<|assistant_end|><|user_start|>Good morning!<|user_end|>
  7. chat 3.91
    that. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>Find the sum of
  8. chat 3.89
    and how to add numbers. Try asking me for a story!<|assistant_end|><|user_start|>What are you good
  9. chat 3.88
    how to add numbers. Try asking me for a story!<|assistant_end|><|bos|><|user_start|>Lucy has 6
  10. chat 3.87
    that. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>Can you write R
  11. chat 3.85
    language model: I can tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>Hi<|user_end|><|assistant_start|>Hi
  12. chat 3.85
    and add numbers, step by step or with a calculator.<|assistant_end|><|bos|><|user_start|>Tell me a story