Skip to content
mini-lab
Features of prelude-2

Feature #850

Fires on “ The” (not labeled yet: read the examples)

Fires on
0.64% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 78%
  • chat 18%
  • worksheet 3%
  • agent 1%
  • python 0%

Makes the model say

sky sun last wind She'( `

Makes it not say

w moral` the Just$ but```

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.96
    <|bos|>One day, a little boy named Tim went for a walk. The air was cool and
  2. chat 4.66
    <|assistant_start|>One day, a little girl named Lucy went for a walk. The sun was shining and
  3. story 4.4
    <|bos|>One day, a strong boy named Tom found a glove. The glove was very
  4. story 4.39
    again.<|bos|>Once upon a time, there was a big cat. The big cat had a
  5. story 4.38
    <|bos|>One day, a little boy named Tim saw a yellow dog. The dog was big and
  6. story 4.36
    a time, in a small house, there lived a grumpy cat. The cat was always cold
  7. story 4.21
    <|bos|>One day, a little girl named Mia found a talking pillow. The pillow was very proud
  8. story 4.18
    to play.⏎In the park, Tim saw a big cat. The cat had some meat
  9. story 4.17
    Spot went for a walk in the park. He saw a cat. The cat was bad.
  10. story 4.17
    him.<|bos|>Once upon a time, there was a grumpy bird. The bird lived near a
  11. story 4.11
    , a big dog and a little cat went to a food place. The big dog was very
  12. story 4.05
    kids in the park. One day, Spot saw a big cat. The cat was a th