Skip to content
mini-lab
Features of prelude-2

Feature #1124

Fires on “ day” (not labeled yet: read the examples)

Fires on
0.60% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 69%
  • chat 11%
  • agent 10%
  • worksheet 5%
  • python 5%

Makes the model say

. and long! enjoy,<|bos|> until

Makes it not say

nameort myppedHello something door hello

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.92
    with her friends. They would run, jump, and laugh together all day long. Lily was
  2. story 3.78
    and the squirrel. They would run, jump, and climb trees all day long. They were
  3. story 3.6
    very happy. She loved her new pillow. She played with it all day, and when it
  4. story 3.57
    bounced very high. Max and Lily played with the new red ball all day long, and they
  5. story 3.53
    The poor mouse was very happy. They played with the fixed toy all day.⏎But then
  6. story 3.51
    you because she loves you."⏎Tim played with the new ball all day. He would throw
  7. story 3.48
    round toy that she had never seen before. She played with it all day long.⏎In
  8. story 3.46
    shiny. Tim loved his new marble. He played with it all day. He rolled it
  9. story 3.43
    a big yard to play in. He loved to run and jump all day long. One day
  10. story 3.41
    can play with it." Tim was happy and played with the ball all day long.<|bos|><|user_start|>
  11. story 3.39
    Sara was so happy.⏎She went home and played with it all day. She loved it
  12. story 3.34
    the snow all day.<|bos|>Once upon