Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3294

Fires on “ sky” (not labeled yet: read the examples)

Fires on
0.80% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 82%
  • chat 12%
  • agent 4%
  • python 1%
  • worksheet 1%

Makes the model say

. like, and very!." when

Makes it not say

])opencodeschemaalculatorRename_*. passes<|user_start|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.0
    this time, something strange happened. The ball flew high up into the sky and did not come
  2. story 4.98
    named Max went for a walk. He saw a square box on the ground. Max was curious
  3. story 4.95
    relax.⏎The bird saw a big, soft cloud in the sky. The bird thought
  4. story 4.94
    !"⏎As they played, the ball rolled into a crack in the ground. The cat and
  5. story 4.86
    and play. One day, the frog saw a big star in the sky. The star was
  6. story 4.83
    . It was friends with a fast jet that could fly high in the sky. The boat and
  7. story 4.83
    happy cat.⏎While playing, Tom saw a big rainbow in the sky. The rainbow was
  8. story 4.83
    the sky. One day, he saw a mysterious cloud up in the sky. It was big
  9. chat 4.82
    park. He saw a big, red balloon floating in the sky. Tim wanted to
  10. story 4.81
    As they walked, they saw a big, pretty sunset in the sky. The colors were
  11. story 4.78
    8<|assistant_end|><|bos|>One day, a little plane was flying high in the sky. It saw a
  12. chat 4.72
    ?<|user_end|><|assistant_start|>One day, a gray bird found a feather on the ground. The feather