Skip to content
mini-lab
Features of prelude-2

Feature #158

Fires on “ the” (not labeled yet: read the examples)

Fires on
1.01% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 64%
  • agent 19%
  • chat 12%
  • python 3%
  • worksheet 3%

Makes the model say

gameir mud. too," grass6

Makes it not say

Once what()`.repeat from everyHello<|think_start|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.32
    named Tom went on a trip. He flew his plane up in the sky.<|assistant_end|><|user_start|>
  2. story 3.24
    day, he would go to the park and throw the ball high in the sky.⏎One
  3. chat 3.23
    to play with his red ball. He would throw it high up in the sky and watch it
  4. story 3.21
    park. Tommy was running around chasing bubbles that floated in the air. Mar
  5. story 3.21
    ball. She loved to play with her ball and throw it high in the sky. The sun
  6. story 3.19
    tree loved watching the bright colors as the sun slowly rose up in the sky. Every morning
  7. story 3.13
    water. It was friends with a fast jet that could fly high in the sky. The boat
  8. story 3.07
    he became very tired. His pants got dirty from playing in the mud.⏎When
  9. story 3.05
    up and flapped his arms, and felt himself soaring high in the sky.⏎The
  10. story 3.0
    , there was a perfect bird. The bird loved to fly high in the sky. It had
  11. story 3.0
    day. He rolled it on the floor, and he threw it in the air. The fit
  12. story 2.98
    time, there was a goose. The goose liked to fly high in the sky. One day