Skip to content
mini-lab
Features of prelude-2

Feature #2370

Fires on “ the” (not labeled yet: read the examples)

Fires on
0.37% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 63%
  • python 16%
  • agent 11%
  • chat 7%
  • worksheet 3%

Makes the model say

and. green sts of little

Makes it not say

<|user_start|>https<|user_end|>emo`. typo examplepped

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.6
    a beautiful view of the fields, the trees, and the sky. They also
  2. story 1.48
    She ran to the stage. She saw the lights and the music. She saw the
  3. story 1.48
    I hope so." She tucked Sara in and turned off the light. She left the
  4. story 1.47
    looked at all the things in the park. He saw the birds and the trees and the funny
  5. story 1.45
    is gone!"⏎They saw the carrot nose, the hat, and the scarf on
  6. story 1.45
    to the tournament and found plenty of mighty steel pieces that he bought
  7. python 1.44
    ⏎```⏎⏎`is_even` returns True if x is even. For example,
  8. story 1.42
    . Zip had many friends, and they all liked his fashion.⏎One day
  9. story 1.4
    outside and raise his hands to the sky. He liked to feel the rain on his metal
  10. story 1.38
    . The cat was so excited! It started to whisper to the rice, telling it
  11. story 1.38
    Let's go say hello!" Ben said.⏎They put down their snowballs and ran
  12. story 1.38
    goes to bed. She sings songs she knows and songs she makes up.⏎One day