Skip to content
mini-lab
Features of prelude-2

Feature #1

Fires on “ It” (not labeled yet: read the examples)

Fires on
1.03% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 84%
  • chat 10%
  • agent 3%
  • python 2%
  • worksheet 1%

Makes the model say

just wasaw InsteadTim brightat free

Makes it not say

neverFix" didn did doesver i

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.25
    leaf move before.⏎The big leaf was not a leaf at all. It was a big
  2. story 5.58
    ! The cat was not a cat at all. It was a big dog
  3. story 5.38
    when he looked closer, he saw that it was not just one ball, but two! The
  4. story 5.34
    in the ground! The sorry ball was not a ball at all. It was a turtle!
  5. story 5.25
    Amy got close, the cat jumped up. It was not a cat! It was a big
  6. story 5.17
    something unexpected happened. The bird was not a bird at all! It was a butterfly. The
  7. chat 4.98
    in a big tree. But, the toy was not a toy. It was a real bird
  8. chat 4.93
    But then, something unexpected happened. The fire was not real. It was just a toy
  9. chat 4.85
    got a shock. The ball was not a ball at all. It was a big,
  10. story 4.81
    bulb started to grow. But it was not a normal flower. It grew into a
  11. story 4.79
    cat. Sally then realized that the machine was not just a printer, but a magic prin
  12. story 4.75
    bird?" The bird said, "I am not a bird. I am a cat." Tim