Skip to content
mini-lab
Features of prelude-2

Feature #2684

Fires on “ day” (not labeled yet: read the examples)

Fires on
1.24% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 82%
  • chat 13%
  • agent 2%
  • worksheet 2%
  • python 1%

Makes the model say

., and long but!." in

Makes it not say

Fixednew<|system_end|> generator_*.`: defines recent

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 7.51
    a restless boy named Tim. He loved to run and play all day. Tim had a
  2. chat 7.45
    a foolish dog named Max. Max loved to run and play all day.<|assistant_end|><|user_start|>Who
  3. story 7.37
    very enthusiastic. He loved to play and run all day. One day,
  4. chat 7.33
    a foolish dog named Max. Max loved to run and play all day.<|assistant_end|><|user_start|>Who
  5. story 7.32
    playful cat named Mimi. Mimi loved to play with her ball all day long. She would
  6. story 7.26
    was a clumsy dog named Spot. Spot loved to play and run all day long. He had
  7. story 7.24
    outside with his friends. They would run, jump, and laugh all day long. Tim was
  8. story 7.23
    was a pink bunny named Lily. She loved to hop and play all day with her friends.
  9. chat 7.21
    a foolish dog named Max. Max loved to run and play all day.<|assistant_end|><|user_start|>Who
  10. story 7.18
    was a little rabbit named Remy. Remy loved to jump and play all day. One sunny day
  11. story 7.14
    friends who liked to play with her. They would run and laugh all day long.⏎One
  12. story 7.03
    was very enthusiastic and liked to jump and play all day.⏎One day