Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3379

Fires on “,” (not labeled yet: read the examples)

Fires on
0.41% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 42%
  • agent 40%
  • chat 16%
  • worksheet 1%
  • python 1%

Makes the model say

there pan good brave stronge here

Makes it not say

<|assistant_end|>name<|user_end|> *!<|tool_start|> Their >

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.75
    <|assistant_end|><|bos|>Once upon a time, there was a big
  2. chat 4.65
    tell me a story about a car?<|user_end|><|assistant_start|>Once upon a time, there was a little
  3. chat 4.61
    <|user_end|><|assistant_start|>Once upon a time, in a cheerful
  4. chat 4.59
    you tell me a story about a dragon<|user_end|><|assistant_start|>Once upon a time, there was a pink
  5. story 4.55
    <|bos|>Once upon a time, there was a little
  6. story 4.55
    <|bos|>Once upon a time, there was a little
  7. story 4.55
    <|bos|>Once upon a time, there was a little
  8. story 4.55
    <|bos|>Once upon a time, there was a little
  9. story 4.55
    <|bos|>Once upon a time, in a big garden
  10. story 4.55
    <|bos|>Once upon a time, there was a girl
  11. chat 4.52
    a cake?<|user_end|><|assistant_start|>Once upon a time, there was a little
  12. chat 4.51
    tell me a story about a fish?<|user_end|><|assistant_start|>Once upon a time, in a big blue