Skip to content
mini-lab
Features of prelude-2

Feature #573

Fires on “ mom” (not labeled yet: read the examples)

Fires on
0.41% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 82%
  • chat 13%
  • agent 3%
  • python 1%
  • worksheet 1%

Makes the model say

and. but?" len anymore said outside

Makes it not say

<|think_end|>Renamesh calculator<|system_end|>ingnew adds

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.73
    One day, a young boy named Tim went to the store with his mom. They needed to
  2. story 5.68
    day, a curious little boy named Tim went to the store with his mom. They needed to
  3. story 5.66
    . One day, she went to the ice-cream shop with her mom.⏎At the
  4. story 5.49
    <|bos|>One day, a boy named Tim went to the store with his mom. They wanted to
  5. story 5.36
    toy bunny. One day, she went to the busy market with her mom. At the market
  6. chat 5.19
    <|assistant_start|>One day, a boy named Tim went to the store with his mom. They wanted to
  7. story 5.08
    to eat gum. One day, Tim went to the store with his mom. They bought gum
  8. chat 5.05
    <|assistant_start|>One day, a boy named Tim went to the zoo with his mom. Tim was
  9. chat 5.03
    a time, a little girl named Lucy went to the park with her mom.<|assistant_end|><|bos|>Once
  10. chat 5.02
    <|assistant_start|>One day, a boy named Tim went to the zoo with his mom. Tim was
  11. story 5.0
    girl named Lily. One day, Lily went to the park with her mom. She saw a
  12. story 4.99
    One day, a little girl named Lily went to the park with her mom. Lily wore her