Skip to content
mini-lab
Features of prelude-2

Feature #3417

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.81% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 42%
  • agent 26%
  • chat 24%
  • python 6%
  • worksheet 1%

Makes the model say

is way lotchtxselfom

Makes it not say

plus For. and, for: friends

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.32
    He gave the cat some juice to drink. The cat liked the juice a lot. Tim and
  2. story 5.95
    They learned that sometimes, something scary can help you when you need it the most.<|bos|><|system_start|>
  3. story 5.95
    52.<|assistant_end|><|bos|>Lily was a green bird who liked to talk a lot. She talked
  4. story 5.79
    anymore. She liked the toy a lot.⏎But
  5. chat 5.45
    All the kids came to look at the cake. They liked the cake a lot. They ate
  6. story 5.44
    when she was sad, and when she was bored. She danced all the time.⏎One
  7. story 5.42
    They all knew that Tim could not really fly, but they loved him anyway. From that
  8. story 5.23
    was a fat cat. It was called Fluffy and it liked to sleep a lot. It would
  9. story 5.2
    that the circle made.⏎Alice loved making circles come alive with her
  10. story 5.09
    who helped a lost boy find his way home. Tim liked the story a lot.⏎When
  11. story 4.81
    y and dark. But Sally was determined to enjoy it anyway. She skipped
  12. chat 4.78
    bedtime, Kitty tried to remember the stories her mom told her.