Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3074

Fires on “ tell” (not labeled yet: read the examples)

Fires on
0.06% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 34%
  • story 23%
  • worksheet 22%
  • agent 17%
  • python 3%

Makes the model say

ies forgot element newP catale Now

Makes it not say

ed9r wind<|assistant_end|> nums said then

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.46
    sure to only buy what
  2. chat 1.37
    tell short stories and add
  3. chat 1.37
    tell me a story?
  4. chat 1.37
    tell short stories and add
  5. chat 1.37
    tell short stories and add
  6. chat 1.37
    tell you short stories for
  7. chat 1.37
    tell stories and add numbers
  8. chat 1.31
    <|bos|><|user_start|>hey there<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>Once
  9. chat 1.27
    .<|assistant_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>What
  10. chat 1.27
    <|bos|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>I
  11. chat 1.27
    assistant.<|system_end|><|user_start|>Hello<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|><|system_start|>
  12. chat 1.26
    <|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>I