Skip to content
mini-lab
Features of prelude-2

Feature #2080

Fires on “ the” (not labeled yet: read the examples)

Fires on
1.39% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 88%
  • chat 8%
  • agent 3%
  • worksheet 1%
  • python 0%

Makes the model say

at saw sky window again see broken lost

Makes it not say

oursfactorial<|arg|><|assistant_end|>akOnce waitshout

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 7.55
    looked at her curtain
  2. story 7.37
    .⏎Anna and Ben sit on the seats. They look out the window. They see
  3. story 7.18
    look by the trees."
  4. story 7.16
    looks like a fun place
  5. story 7.14
    Lily said.⏎They drove for a long time. Lily looked out the window and saw trees
  6. story 7.05
    trash.⏎They sit on the seats again. They look out the window. They see
  7. story 6.84
    !"⏎Mommy looked up. "Oh my
  8. story 6.57
    unexpected happened. The dog on the video stopped playing and looked right at Tim. The
  9. story 6.48
    . A little girl named Lily was inside her house. She looked out the window and saw her
  10. story 6.41
    , so his mom decided to go back home.⏎Max looked out the window and saw a
  11. story 6.29
    . He sat down at his desk and looked at his watch.
  12. story 6.28
    went outside and looked around.⏎He saw