Skip to content
mini-lab
Features of prelude-2

Feature #3766

Fires on “ a” (not labeled yet: read the examples)

Fires on
1.40% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 83%
  • chat 15%
  • agent 1%
  • python 1%
  • worksheet 0%

Makes the model say

new big small little many returns realprint

Makes it not say

<|assistant_end|>Run.akes rain awayide Every

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.59
    sun. While he was hopping, he saw a strange object
  2. story 6.5
    new things together. As they walked, they saw a big, pretty sun
  3. chat 6.42
    the water. One day, while he was diving, he saw a big, black rock
  4. story 6.1
    there. Then, she saw a little boy named Tim
  5. chat 6.07
    he saw a big ball. He
  6. story 6.07
    One day, he found a bulb in
  7. chat 6.07
    , the pink witch saw a little bird. The
  8. story 5.92
    from the storm. But then, they saw a sign that said,
  9. story 5.92
    would roll and jump in it all day. One day, Tom saw a big dog named Max
  10. story 5.91
    to play with his friends in the park. One day, Buddy saw a big ball near the
  11. story 5.89
    , a mighty big cat named Tom went for a walk. He saw a little dog named Tim
  12. story 5.88
    . One day, she found a weird, round toy