Skip to content
mini-lab
Features of prelude-2

Feature #675

Fires on “ as” (not labeled yet: read the examples)

Fires on
0.51% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 52%
  • agent 17%
  • python 16%
  • chat 13%
  • worksheet 3%

Makes the model say

(" make made water makesutils many returns

Makes it not say

ation<|bos|>⏎Fixed righthed result back

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.32
    as and went to bed. He yawned again and fell fast asleep. Tim
  2. story 2.25
    listen and she fell asleep with her
  3. story 2.07
    and have fun. They played games, ate yummy food, and danced to music.⏎At
  4. story 2.06
    and jumped onto his couch. He was full of happiness and he fell asleep with a
  5. story 1.98
    One sunny day, Pinky was feeling sad because he could not jump as high as his friend
  6. story 1.91
    is that sharing can make everyone happy, even when things don't go as planned.<|bos|>
  7. chat 1.85
    a story about a big, strong lion. Kitty felt happy and fell asleep with a
  8. story 1.8
    She held Mom's hand. They left the mall. Lily fell asleep in the
  9. story 1.8
    warm milk and tucked them in bed. Mia and Ben fell asleep, dream
  10. story 1.8
    and turned off the light. Fluffy snuggled with Anna and fell asleep. He
  11. story 1.79
    with their mom and dad. They liked to play in the sand and splash in the water.
  12. chat 1.79
    <|assistant_start|>Hi there! Would you like a story, or some numbers to add?<|assistant_end|><|user_start|>