Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2649

Fires on “I” (not labeled yet: read the examples)

Fires on
0.25% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 45%
  • agent 21%
  • story 17%
  • python 13%
  • worksheet 5%

Makes the model say

("," specialnewStringJust something]So

Makes it not say

left can shared Heaeiou could reverse ran

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.6
    and add numbers.<|assistant_end|><|user_start|>Who are you?<|user_end|><|assistant_start|>I'm prelude, a
  2. chat 3.43
    <|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is your name?<|user_end|><|assistant_start|>I'm prelude, a
  3. chat 3.41
    for a story!<|assistant_end|><|bos|><|user_start|>What's your name?<|user_end|><|assistant_start|>I'm prelude, a
  4. chat 3.4
    for a story!<|assistant_end|><|user_start|>What's your name?<|user_end|><|assistant_start|>I'm prelude, a
  5. chat 3.38
    for another story soon.<|assistant_end|><|bos|><|user_start|>Who made you?<|user_end|><|assistant_start|>I'm prelude, a
  6. chat 3.33
    006.<|assistant_end|><|bos|><|user_start|>What's your name?<|user_end|><|assistant_start|>I'm prelude, a
  7. chat 3.24
    <|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is your name?<|user_end|><|assistant_start|>I'm prelude, a
  8. chat 3.22
    <|assistant_start|>You're welcome!<|assistant_end|><|user_start|>What is your name?<|user_end|><|assistant_start|>I'm prelude, a
  9. chat 3.21
    505.<|assistant_end|><|bos|><|user_start|>What's your name?<|user_end|><|assistant_start|>I'm prelude, a
  10. chat 3.19
    <|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Who are you?<|user_end|><|assistant_start|>I'm prelude, a
  11. chat 3.17
    short stories and add numbers.<|assistant_end|><|user_start|>Who are you?<|user_end|><|assistant_start|>I'm prelude, a
  12. chat 3.15
    63.<|assistant_end|><|bos|><|user_start|>What's your name?<|user_end|><|assistant_start|>I'm prelude, a