Skip to content
mini-lab
Features of prelude-2

Feature #3207

Fires on “ high” (not labeled yet: read the examples)

Fires on
0.72% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 71%
  • chat 14%
  • python 10%
  • agent 3%
  • worksheet 2%

Makes the model say

high upap abher wings skyri

Makes it not say

<|assistant_end|>fact filesThis thisOncepered<|arg|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.47
    a time, there was a perfect bird. The bird loved to fly high in the sky.
  2. story 5.25
    <|think_end|>968<|assistant_end|><|bos|>One day, a little plane was flying high in the sky.
  3. story 5.23
    was a big, thick bird named Bobo. Bobo loved to soar high in the sky.
  4. story 5.19
    upon a time, there was a goose. The goose liked to fly high in the sky.
  5. story 5.11
    a time, there was a gray bird named Bobo. Bobo could fly high up in
  6. chat 5.06
    Once upon a time, there was a big bird who could fly very high.<|assistant_end|><|bos|>4
  7. story 5.01
    big kick. But this time, something strange happened. The ball flew high up into the sky
  8. story 5.0
    a little bird named Blue. Blue loved to spread his wings and fly high in the sky.
  9. story 4.9
    day, they all wanted to surprise him.⏎The little bird flew high and far to the
  10. story 4.82
    very attractive with bright feathers. Blue loved to soar high in the sky and
  11. story 4.8
    a flap of his wings!⏎One day, Tim was flying high in the sky when
  12. story 4.73
    <|assistant_end|><|bos|>Once upon a time, a bird named Bob wanted to fly high in the sky.