Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2360

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.88% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 50%
  • chat 31%
  • agent 10%
  • worksheet 6%
  • python 2%

Makes the model say

timeofvowelsly⏎ import function=

Makes it not say

listened othersHello more plus some everyonemin

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 9.97
    can you tell me a story about a dragon<|user_end|><|assistant_start|>Once upon a time, there was
  2. chat 9.84
    about a dragon.<|user_end|><|assistant_start|>Once upon a time, there was
  3. chat 9.73
    Can you tell me a story about a car?<|user_end|><|assistant_start|>Once upon a time, there was
  4. chat 9.68
    tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was
  5. chat 9.65
    you tell me a story about a fish?<|user_end|><|assistant_start|>Once upon a time, in a
  6. chat 9.62
    Can you tell me a story?<|user_end|><|assistant_start|>Sure! Once upon a time, there was
  7. chat 9.62
    <|system_end|><|user_start|>I want a story!<|user_end|><|assistant_start|>Sure! Once upon a time, there was
  8. story 9.6
    <|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|>Once upon a time, in a
  9. chat 9.53
    a cake?<|user_end|><|assistant_start|>Once upon a time, there was
  10. chat 9.49
    want a story about the sea!<|user_end|><|assistant_start|>Sure! Once upon a time, in a
  11. chat 9.46
    .<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was
  12. story 9.45
    <|assistant_start|>The answer is 86.<|assistant_end|><|bos|>Once upon a time, there was