Skip to content
mini-lab
Features of prelude-2

Feature #2218

Fires on “ in” (not labeled yet: read the examples)

Fires on
0.91% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 68%
  • chat 27%
  • worksheet 2%
  • agent 2%
  • python 1%

Makes the model say

a an in townOne One Mr kind

Makes it not say

contentreplaceAll he<|assistant_end|>expression generatorCreatedw

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.29
    Once upon a time, in a big sky,
  2. story 5.22
    <|bos|>Once upon a time, there was a big giant. He lived in a huge, expensive
  3. story 5.2
    upon a time, in a big forest,
  4. story 5.18
    <|bos|>Once upon a time, in a big garden,
  5. story 5.13
    495<|assistant_end|><|bos|>Once upon a time, in a small house near
  6. story 5.08
    <|bos|>Once upon a time, there was a girl named Lucy. She had a pretty unif
  7. story 4.95
    <|bos|>Once upon a time, there was a girl named Lily. She had a big box of
  8. chat 4.89
    <|user_end|><|assistant_start|>Once upon a time, in a cheerful forest
  9. chat 4.88
    <|assistant_start|>Once upon a time, there was a princess. She lived in a big, pretty
  10. story 4.87
    <|bos|>Once upon a time, there was a small princess. She lived in a big castle with
  11. story 4.84
    to show everyone back home!<|bos|>Once upon a time, in a small village,
  12. story 4.83
    ing colors and playing together.<|bos|>Once upon a time, in a big forest,