Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1921

Fires on “ there” (not labeled yet: read the examples)

Fires on
0.51% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 40%
  • chat 26%
  • agent 23%
  • worksheet 10%
  • python 0%

Makes the model say

be an help sun just play a

Makes it not say

item list)` store echo will plants short

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.93
    tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a girl named
  2. chat 2.82
    <|assistant_start|>Once upon a time, there was a little bunny
  3. chat 2.8
    about a dragon.<|user_end|><|assistant_start|>Once upon a time, there was a yellow dragon
  4. chat 2.76
    me a story about a dragon.<|user_end|><|assistant_start|>Once upon a time, there was a big dragon
  5. chat 2.71
    me a story about a car?<|user_end|><|assistant_start|>Once upon a time, there was a little red
  6. chat 2.71
    a cake?<|user_end|><|assistant_start|>Once upon a time, there was a little girl
  7. chat 2.71
    <|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time, there was a dog.
  8. chat 2.71
    a short story about a tree.<|user_end|><|assistant_start|>Once upon a time, there was an ancient tree
  9. chat 2.7
    <|user_start|>Tell me a short story.<|user_end|><|assistant_start|>Once upon a time, there was a little boy
  10. chat 2.7
    Once upon a time, there was a large cat
  11. story 2.7
    Once upon a time, there was a lawy
  12. chat 2.69
    Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a sailor.