Skip to content
mini-lab
Features of prelude-2

Feature #763

Fires on “ there” (not labeled yet: read the examples)

Fires on
0.30% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 45%
  • agent 39%
  • chat 14%
  • python 1%
  • worksheet 0%

Makes the model say

ME element==**/ememberassert metER

Makes it not say

backing girled awayies were take

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.19
    <|user_end|><|assistant_start|>Sure! Once upon a time, in a small house, there was a wise
  2. story 3.01
    .<|assistant_end|><|bos|>Once upon a time, in a quiet little house, there was a small stove
  3. chat 2.95
    fish?<|user_end|><|assistant_start|>Once upon a time, in a big blue sea, there was a dependable
  4. story 2.93
    ⏎<|bos|>Once upon a time, in a small, humble house, there lived a little
  5. story 2.9
    1<|assistant_end|><|bos|>Once upon a time, in a tidy little house, there lived a young boy
  6. story 2.9
    <|assistant_end|><|bos|>Once upon a time, in a bright, sunny house, there lived a little girl
  7. story 2.89
    bird.<|bos|>Once upon a time, in a tidy little house, there lived a boy named
  8. story 2.89
    "!"⏎```⏎<|bos|>Once upon a time, in a small house, lived a charming cat
  9. story 2.89
    a story!<|assistant_end|><|bos|>Once upon a time, in a small house, there was a little
  10. chat 2.83
    the sea!<|user_end|><|assistant_start|>Once upon a time, in a big sea, there was a little
  11. story 2.8
    park.<|bos|>Once upon a time, in a lovely little house, there lived a hunter
  12. chat 2.79
    ?<|user_end|><|assistant_start|>Once upon a time, in a big blue sea, there was a dependable fish