Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #966

Fires on “ today” (not labeled yet: read the examples)

Fires on
1.37% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 47%
  • agent 25%
  • story 12%
  • worksheet 8%
  • chat 8%

Makes the model say

))ap)` contains en % import minus

Makes it not say

big Sam He put+ lot She cars

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.68
    ⏎<|bos|><|user_start|>Hello!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|><|system_start|>
  2. chat 2.63
    <|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|>Once
  3. chat 2.62
    .<|bos|><|user_start|>Hi!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>I
  4. chat 2.59
    <|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|>Once
  5. chat 2.59
    <|assistant_end|><|bos|><|user_start|>Hi!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>I
  6. chat 2.57
    <|bos|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>I
  7. chat 2.57
    assistant.<|system_end|><|user_start|>Hello<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|><|system_start|>
  8. chat 2.56
    <|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>Can
  9. chat 2.56
    .<|system_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|>One
  10. chat 2.55
    calculator<|system_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>c
  11. chat 2.55
    <|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>Bye
  12. chat 2.54
    <|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>I