Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1962

Fires on “ the” (not labeled yet: read the examples)

Fires on
1.81% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 64%
  • agent 21%
  • chat 13%
  • python 2%
  • worksheet 0%

Makes the model say

store park treeu party placech wise

Makes it not say

<|tool_call_end|> plus_*. calculator typo`:commandpt

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 8.21
    ⏎One day, their mom said, "I have to go to the store. You two
  2. story 8.21
    time!<|assistant_end|><|bos|>One day, Tom and his mom went to the store. They saw
  3. story 8.14
    she now had her very own dinosaur!<|bos|>Lily and Mom went to the mall. Lily
  4. story 8.13
    he went. One day, Tim's mom said they were going to the store. Tim was
  5. story 7.92
    is 173.<|assistant_end|><|bos|>Mia and her mom went to the park. Mia loved
  6. chat 7.86
    a short story about a bird.<|user_end|><|assistant_start|>Today Bob went to the park. He
  7. story 7.75
    a boy named Jimmy. He was very excited because he was going to the top of a high
  8. story 7.74
    . One day, Joe was getting ready with his mommy to go to a party. He was
  9. story 7.71
    her baby doll everywhere she went.⏎One day, Anna went to the park with her mom
  10. story 7.68
    She loved to eat delicious ice cream. One day, she went to the park with her mom
  11. story 7.68
    One sunny day, a little girl named Mia was eager to go to the gym.
  12. story 7.66
    to play with his rope. One day, he wanted to go to the park. So,