Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3029

Fires on “,” (not labeled yet: read the examples)

Fires on
1.24% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 61%
  • agent 22%
  • python 10%
  • chat 6%
  • worksheet 1%

Makes the model say

around fastg barkedgeowed")` jumped

Makes it not say

is stories return<|bos|> equalsis Every lonely

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.07
    played with her friends. They ran, jumped, and called
  2. story 3.92
    ran to safety
  3. story 3.87
    big smile and loved to play outside with her friends. They would run, jump, and laugh
  4. story 3.86
    in the mud. One day, Spot saw a big mud puddle and ran to jump in it
  5. story 3.85
    felt bad. She ran and scattered
  6. story 3.77
    with his favorite toy, a long staff. He would run, jump, and bow
  7. story 3.76
    s and horns. It roared and chased her. She ran and ran, but it
  8. story 3.7
    together. Tim loved to play outside with Max, and they would run and jump all day long
  9. chat 3.69
    , but the dragon followed her. She was so graceful that she ran and ran until she found
  10. story 3.66
    saw a big, terrible bug. Lily was scared and ran inside her house.
  11. story 3.6
    the ball home, so he picked it up in his mouth and ran away.⏎Max
  12. story 3.52
    , the bunny, the bird, and the squirrel. They would run, jump, and climb