Skip to content
mini-lab
Features of prelude-2

Feature #2220

Fires on “,” (not labeled yet: read the examples)

Fires on
1.50% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 78%
  • chat 12%
  • agent 7%
  • python 2%
  • worksheet 1%

Makes the model say

but But if pushed pulled ball first rolled

Makes it not say

readThank thankThe<|bos|>combine happy "!"

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.95
    . They were playing with a ball. Spot tried to catch the ball, but it was too
  2. story 2.95
    know what game they would watch.⏎Tim tried to read the sign, but the words were
  3. story 2.85
    to play with it.⏎Buddy tried to play with the ball, but his friends did
  4. story 2.79
    went to the park with her friends. They saw a big red ball stuck high up in a
  5. story 2.74
    dot on the wall. The cat tried to catch the dot, but it moved too
  6. story 2.7
    wanted to wear her expensive dress. She tried to zip it up, but it was stuck
  7. story 2.67
    wanted to climb it.⏎Tim tried to crawl up the chair, but it was too
  8. story 2.67
    . They played fun games together. The mill would spin fast, and Lily would laugh.
  9. chat 2.63
    the toy car did not move. The toy dog tried to push it, but it did not
  10. story 2.62
    One day, Max saw a little girl crying. Her red ball was stuck high up in a
  11. story 2.58
    in the bed too.⏎The cat tried to fit in the bed, but it was too
  12. story 2.57
    One day, while the butterfly was flying, it saw a small bug stuck in a spider we