Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3160

Fires on “ bird” (not labeled yet: read the examples)

Fires on
1.79% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 77%
  • chat 18%
  • agent 5%
  • python 1%
  • worksheet 0%

Makes the model say

.'s and, who that st sc

Makes it not say

agedycommandvalueupperminWritereet

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 7.07
    , there was a unique little bird named Tim. Tim
  2. story 6.9
    forest, there was a little rabbit named Remy. He
  3. story 6.56
    544.<|bos|>Once upon a time, there was a naughty cat named Tom. Tom
  4. story 6.55
    70.<|assistant_end|><|bos|>Once upon a time, there was a small cat named Tom. Tom
  5. story 6.52
    25.<|assistant_end|><|bos|>Once upon a time, there was a little bird named Tim. Tim
  6. story 6.51
    1382<|bos|>Once upon a time, there was an ugly frog. He lived in
  7. story 6.51
    add numbers.<|assistant_end|><|bos|>Once upon a time, there was a small bird who had a nest
  8. story 6.47
    its new friend.<|bos|>Once upon a time, there was a furry cat named Kitty. Kitty
  9. story 6.46
    proud of him.<|bos|>Once upon a time, there was a grumpy bird. The bird lived
  10. story 6.46
    this project.<|assistant_end|><|bos|>Once upon a time, there was a little squirrel named Sam. Sam
  11. chat 6.41
    <|assistant_start|>Once upon a time, there was a little bunny named Bobo. Bobo
  12. story 6.37
    7⏎```<|assistant_end|><|bos|>Once upon a time, there was a young bird named Tim. Tim