Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2779

Fires on “<|user_start|>” (not labeled yet: read the examples)

Fires on
0.58% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 64%
  • agent 28%
  • story 7%
  • python 1%
  • worksheet 0%

Makes the model say

Onceterwaymany `Can# she

Makes it not say

little s be other cry)) or n

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.13
    best of friends forever.<|bos|><|user_start|>Write a short story
  2. chat 3.1
    waved goodbye to his new friend and went home to get warm.<|bos|><|user_start|>Could you tell me
  3. chat 3.09
    rest of the party.<|bos|><|user_start|>Calculate 30
  4. chat 2.97
    new friend and had a lot of fun finding the wheat.<|bos|><|user_start|>What is 4
  5. chat 2.97
    189<|think_end|>The answer is 189.<|assistant_end|><|bos|><|user_start|>I need to know
  6. chat 2.96
    played more games at the camp.<|assistant_end|><|bos|><|user_start|>Sue has 4
  7. chat 2.95
    +3=3, 39<|think_end|>39<|assistant_end|><|bos|><|user_start|>What is 1
  8. chat 2.93
    with happy memories of the shining day at the festival.<|bos|><|user_start|>Can you book a
  9. chat 2.92
    105<|think_end|>The answer is 105.<|assistant_end|><|bos|><|user_start|>Write a short story
  10. chat 2.91
    them with their friends. And they all lived happily ever after.<|bos|><|user_start|>Tell me a story
  11. chat 2.9
    5, 5, 5])⏎2⏎<|bos|><|user_start|>Thanks!<|user_end|>
  12. chat 2.9
    , 94<|think_end|>The answer is 94.<|assistant_end|><|bos|><|user_start|>I need to know