Skip to content
mini-lab
Features of prelude-2

Feature #4016

Fires on “ and” (not labeled yet: read the examples)

Fires on
0.32% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 65%
  • python 16%
  • story 12%
  • chat 6%
  • worksheet 1%

Makes the model say

Then then SoThen howhttps:// say

Makes it not say

erked latepy<|arg|> lost mainle

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.94
    hole. What do you think is inside?" Sue thought for a moment and said, "Maybe
  2. story 2.78
    not like me. What can we do?" Sue thought for a moment and said, "I
  3. story 2.68
    him, but he is sick." Tim's mom thought for a moment and then decided to help
  4. story 2.66
    ⏎Poppy thought for a moment and had an idea.
  5. story 2.56
    be the best swimmer in the sea." Fin thought for a moment and said, "Let
  6. story 2.51
    is dirty now. What should we do?" Tim thought for a moment and said, "Let
  7. story 2.49
    normal. Can you add something special?"⏎Lily thought for a moment and decided to add a
  8. story 2.48
    older sister replied.⏎The younger sister thought for a moment and then said, "
  9. story 2.45
    to help Bouncy.⏎Bunny thought for a moment and then said, "
  10. story 2.44
    didn't have a toy to play with. Bob thought for a moment and then said, "
  11. story 2.43
    know, but I want to open it." Lily thought for a moment and then suggested
  12. story 2.42
    can we do with this cable?"⏎Sam thought for a moment and said, "Let