Skip to content
mini-lab
Features of prelude-2

Feature #1874

Fires on “ at” (not labeled yet: read the examples)

Fires on
0.45% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 72%
  • chat 13%
  • agent 10%
  • python 4%
  • worksheet 1%

Makes the model say

firstdemolists files last sunde*

Makes it not say

.8 and9 of there to<|bos|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.11
    named Sue. Sue loved to play at the park. Her favorite thing at the park was the
  2. story 5.06
    Fluffy went to a big party. There was a lot of delicious food at the party. Sue
  3. story 4.85
    her mom was watching a film. She liked the film because it had attractive colors and
  4. story 4.81
    's mom had a surprise for him. She had found a yellow car at a different store!
  5. story 4.76
    Lily could not wait to tell her grandma about the magic bird she met at the airport
  6. story 4.65
    . But then, something unexpected happened. The bird was not a bird at all! It was
  7. story 4.65
    was gone. Sue felt even more sad because now she had no bird at all.<|bos|><|system_start|>
  8. story 4.65
    aisy didn't understand what Daddy meant at first. But then
  9. story 4.61
    loved yogurt very much, especially the one with fruit at the bottom.⏎
  10. story 4.6
    herself. It was bitter and yucky. Lily did not like it at all.⏎Later
  11. story 4.56
    and gave it a hug. The kitten was not scary at all. Sue took
  12. story 4.5
    dad and they both laughed.⏎The flexible lip was not scary at all, it was