Skip to content
mini-lab
Features of prelude-2

Feature #88

Fires on “ lived” (not labeled yet: read the examples)

Fires on
0.42% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 70%
  • chat 21%
  • python 4%
  • agent 3%
  • worksheet 2%

Makes the model say

herOnce his a[ anOne Tom

Makes it not say

⏎ Createdstatshow games 'edop

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.44
    day.<|bos|>Once upon a time, in a small town, there lived a little boy named
  2. story 4.41
    .<|assistant_end|><|bos|>Once upon a time, in a small town, there lived a cute dog named
  3. story 4.35
    trying.<|bos|>Once upon a time, in a small town, there lived a boy named Tim
  4. story 4.29
    <|bos|>Once upon a time, in a bright, sunny house, there lived a little girl named
  5. story 4.27
    passed⏎<|bos|>Once upon a time, in a jolly town, there lived a kind man.
  6. story 4.25
    ⏎```⏎<|bos|>Once upon a time, in a small house, lived a charming cat named
  7. story 4.25
    87<|bos|>Once upon a time, in a big forest, there lived a clumsy bear named
  8. story 4.24
    adventure.<|bos|>Once upon a time, in a small house, there lived a grumpy cat.
  9. story 4.24
    ⏎<|bos|>Once upon a time, in a big green field, there lived an amazing goat named
  10. story 4.19
    <|bos|>Once upon a time, in a big palace, there lived a king and a
  11. story 4.19
    2.<|bos|>Once upon a time, in a small house, there lived a little boy named
  12. story 4.18
    more.<|bos|>Once upon a time, in a big forest, there lived a good tiger named