Skip to content
mini-lab
Features of prelude-2

Feature #1614

Fires on โ€œ<|user_end|>โ€ (not labeled yet: read the examples)

Fires on
1.64% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 58%
  • agent 24%
  • worksheet 9%
  • python 6%
  • story 3%

Makes the model say

<|user_end|>returnAssertionErrorWhichMyool'Ex

Makes it not say

, in and` find c8 with

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.94
    9.<|bos|><|user_start|>When did World War II end?<|user_end|><|assistant_start|>I'm
  2. chat 3.9
    and add numbers.<|assistant_end|><|user_start|>Who are you?<|user_end|><|assistant_start|>I'm prelude
  3. worksheet 3.75
    add 5781 and 2952 for me?โŽ578
  4. chat 3.74
    Python files in this project.<|assistant_end|><|bos|><|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude
  5. chat 3.72
    to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>Who made you?<|user_end|><|assistant_start|>I'm prelude
  6. chat 3.72
    step or with a calculator.<|assistant_end|><|user_start|>How can you help me?<|user_end|><|assistant_start|>I'm prelude
  7. chat 3.7
    for me?<|user_end|><|assistant_start|>The answer
  8. chat 3.7
    <|user_start|>Can you add 38 and 327 for me?<|user_end|><|assistant_start|><|think_start|>0
  9. chat 3.69
    s and how they treat you.<|bos|><|user_start|>What is your name?<|user_end|><|assistant_start|>My name is
  10. chat 3.68
    only tell short stories and add numbers.<|assistant_end|><|user_start|>Who are you?<|user_end|><|assistant_start|>I'm prelude
  11. chat 3.68
    Come back for another story soon.<|assistant_end|><|bos|><|user_start|>Who made you?<|user_end|><|assistant_start|>I'm prelude
  12. chat 3.67
    you add 798 and 551 for me?<|user_end|><|assistant_start|><|think_start|>79