Skip to content
mini-lab
Features of prelude-2

Feature #1701

Fires on “<|user_start|>” (not labeled yet: read the examples)

Fires on
2.47% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 49%
  • chat 48%
  • python 1%
  • story 1%
  • worksheet 1%

Makes the model say

pl(- counts checks([Added needed

Makes it not say

, that not the in. all sad

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.09
    for a story!<|assistant_end|><|user_start|>What's your name
  2. chat 3.01
    <|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|><|user_start|>what is your name
  3. chat 2.98
    0 + 4?<|user_end|><|assistant_start|>The answer is 4.<|assistant_end|><|user_start|>Now add 2
  4. chat 2.94
    . He stumbled on the grass as he walked.<|assistant_end|><|user_start|>Calculate 22
  5. chat 2.91
    7 to that?<|user_end|><|assistant_start|>The answer is 41.<|assistant_end|><|user_start|>Now add 3
  6. chat 2.91
    add 2?<|user_end|><|assistant_start|>The answer is 24.<|assistant_end|><|user_start|>Plus 1?
  7. chat 2.9
    night!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|user_start|>write a C
  8. chat 2.9
    He looked at his mom and dad flying high in the sky.<|assistant_end|><|user_start|>Hey, what's
  9. chat 2.89
    <|user_start|>0 + 4<|user_end|><|assistant_start|>The answer is 4.<|assistant_end|><|user_start|>Plus 25
  10. chat 2.89
    night!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|><|user_start|>Hey, what's
  11. chat 2.89
    night!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|user_start|>Compute 39
  12. chat 2.87
    24.<|user_end|><|assistant_start|>The answer is 25.<|assistant_end|><|user_start|>What if you add