Skip to content
mini-lab
Features of prelude-2

Feature #2547

Fires on “ there” (not labeled yet: read the examples)

Fires on
0.26% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 71%
  • chat 26%
  • python 1%
  • agent 1%
  • worksheet 1%

Makes the model say

went was could would she walk came come

Makes it not say

Thankave bit lesson about goodbye that len

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 6.29
    tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a girl named
  2. chat 6.17
    a cake?<|user_end|><|assistant_start|>Once upon a time, there was a little girl
  3. chat 6.16
    about a dragon.<|user_end|><|assistant_start|>Once upon a time, there was a yellow dragon
  4. chat 6.13
    me a story about a car?<|user_end|><|assistant_start|>Once upon a time, there was a little red
  5. chat 6.03
    <|assistant_start|>Once upon a time, there was a little bunny
  6. chat 5.96
    Once upon a time, there was a large cat
  7. story 5.96
    Once upon a time, there was a lawy
  8. chat 5.89
    tell me a story about a dragon<|user_end|><|assistant_start|>Once upon a time, there was a pink dragon
  9. story 5.88
    stories and add numbers.<|assistant_end|><|bos|>Once upon a time, there was a clever little
  10. chat 5.82
    me a story about a dragon.<|user_end|><|assistant_start|>Once upon a time, there was a big dragon
  11. chat 5.79
    ?<|user_end|><|assistant_start|>Once upon a time, there was a girl named
  12. chat 5.79
    ?<|user_end|><|assistant_start|>Once upon a time, there was a fat crab