Skip to content
mini-lab
Features of prelude-2

Feature #885

Fires on “ ever” (not labeled yet: read the examples)

Fires on
0.43% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 78%
  • story 17%
  • python 3%
  • chat 2%
  • worksheet 1%

Makes the model say

dog big after small lost backayide

Makes it not say

if onlyEADME both<|system_start|>:<|assistant_end|>llo

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.16
    laughed. And they lived happily ever after.<|bos|><|system_start|>
  2. story 3.01
    name on it to play with her friend again. And they lived happily ever after.<|bos|>Once
  3. story 2.93
    and shared them with their friends. And they all lived happily ever after.<|bos|><|user_start|>
  4. story 2.93
    the adventures she could have with her toys. And they all lived happily ever after.<|bos|><|system_start|>
  5. story 2.78
    and said, "You're welcome!"⏎And they both lived happily ever after.<|bos|><|user_start|>
  6. story 2.78
    to explore the world and have fun. And so, they lived happily ever after.<|bos|>7
  7. chat 2.75
    how strong and fast the bird had become.⏎The bird lived happily ever after, happy and
  8. story 2.74
    good to listen and ask for help from others. And they played happily ever after.<|bos|>Once
  9. story 2.69
    became friends and played together with their toys. And they all lived happily ever after.<|bos|><|system_start|>
  10. story 2.67
    a peaceful place for them to play. And Kitty and Doggy lived happily ever after.<|bos|><|system_start|>
  11. story 2.67
    ent stayed safe and shiny on the tree. And they all lived happily ever after.<|bos|>How
  12. story 2.62
    . They played together and became best friends. And they all lived happily ever after.<|bos|><|system_start|>