Skip to content
mini-lab
Features of prelude-2

Feature #862

Fires on “ the” (not labeled yet: read the examples)

Fires on
2.54% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 83%
  • chat 10%
  • agent 5%
  • worksheet 1%
  • python 1%

Makes the model say

new the big little The this shiny

Makes it not say

<|arg|> earars teethbox#MIT<|assistant_start|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.15
    about what could be inside. So, Tim and Sue decided to open the mailbox together.⏎
  2. story 4.99
    chest in the yard. He was very excited.⏎Max opened the chest and found
  3. story 4.89
    smiled. She said, "Yes, Tim, you can play with the hook. But be
  4. story 4.84
    mud puddle and ran to jump in it.⏎When Spot jumped in the mud, he heard
  5. story 4.81
    and had many colors.⏎Tim asked his mom if they could read the unusual book together.
  6. story 4.74
    named Lucy, came to help him. With her help, they opened the sack and found lots
  7. story 4.73
    ! Can I play with it too?"⏎Sue and Tim played with the flexible toy all day
  8. story 4.71
    wanted to enter the tent to see what was inside.⏎Inside the tent, he met
  9. story 4.64
    there." Sue was excited to meet the teacher.⏎They went inside the building and met the
  10. story 4.62
    was very big and full of water. Many kids liked to play in the pool. They would
  11. story 4.59
    Lucy ran to her mom and said, "Mom, can we open this box? I think
  12. story 4.58
    Tim saw a big pie and said, "Mom, can we get this one?" His mom