Skip to content
mini-lab
Features of prelude-2

Feature #665

Fires on “ the” (not labeled yet: read the examples)

Fires on
0.56% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 76%
  • chat 15%
  • agent 8%
  • worksheet 1%
  • python 1%

Makes the model say

very big so first top sun fast shiny

Makes it not say

.: +."<|user_end|>," plus`,

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.02
    a boy named Jimmy. He was very excited because he was going to the top of a high
  2. chat 3.92
    <|user_end|><|assistant_start|>One day, a large bunny named Bob wanted to hop to the store.<|assistant_end|><|bos|>
  3. chat 3.91
    a short story about a bird.<|user_end|><|assistant_start|>Today Bob went to the park. He
  4. story 3.88
    One sunny day, a little girl named Mia was eager to go to the gym.
  5. story 3.83
    , there was a little girl called Sally. Sally wanted to go to the park with her mom
  6. story 3.72
    have nice toys. He saved up all his pocket money to go to the store to buy his
  7. story 3.62
    ⏎Then they went outside to play. They saw a hedge at the end of the garden
  8. story 3.62
    1]`. The tests pass now.<|assistant_end|><|bos|>Sam likes to go to the park with his mom
  9. story 3.61
    you.<|bos|>Henry had a great day. He was at the park with his family
  10. story 3.61
    play outside. One day she asked her mum if they could go to the park.⏎Mum
  11. chat 3.56
    Once upon a time, there was a bunny who wanted to jump to the moon. He asked
  12. story 3.54
    ⏎<|bos|>Little Reema was so excited to go to the amusement