Skip to content
mini-lab
Features of prelude-2

Feature #2321

Fires on “ fly” (not labeled yet: read the examples)

Fires on
1.06% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 73%
  • chat 12%
  • agent 9%
  • python 3%
  • worksheet 2%

Makes the model say

high lived strong beautifulbThank live thanked

Makes it not say

<|think_start|> ' last When resultway multiply

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.03
    , the bird's wing got better. One day, the bird could fly again. The bird
  2. chat 3.87
    was done, Dara tried to flap her wings. She could fly again! Dara
  3. story 3.82
    upon a time, there was a gray bird named Bobo. Bobo could fly high up in
  4. story 3.8
    sail on the water. It was friends with a fast jet that could fly high in the sky
  5. story 3.77
    Thank you, Spot," said the little bird. "Now I can fly again!"⏎Spot
  6. story 3.72
    3.<|bos|>Once upon a time, there was a bird who could fly. This bird was
  7. story 3.72
    to their surprise, they both turned into birds! Now, they could fly high in the sky
  8. chat 3.67
    had big claws, a sparkly scale and it could roar very loud.
  9. story 3.65
    ! The kite said, "Thank you, Tim! Now I can fly with my kite friends
  10. chat 3.63
    <|user_end|><|assistant_start|>Once upon a time, there was a big bird who could fly very high.<|assistant_end|>
  11. story 3.56
    , his nest was very safe and strong. Bob was happy and could fly high in the sky
  12. story 3.54
    the bird smiled. The next day, the bird felt better and could fly again. Tim was