Skip to content
mini-lab
Features of prelude-2

Feature #3524

Fires on “ beach” (not labeled yet: read the examples)

Fires on
1.21% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 79%
  • chat 14%
  • agent 5%
  • python 1%
  • worksheet 0%

Makes the model say

where more count with many all together.

Makes it not say

upon touched youendYouNameError<|think_start|>he

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.22
    every number of nums doubled.<|assistant_end|><|bos|>Tom and Lily went to the beach with their mom and
  2. story 6.14
    3)` returns `8`.⏎<|bos|>Anna and Ben went to the beach with Mom and Dad
  3. story 5.58
    contains<|assistant_end|><|bos|>One day, a little boy named Tim went to the beach with his family.
  4. chat 5.57
    <|assistant_start|>Sure! One day, a little boy named Tim went to the beach. He saw a
  5. story 5.49
    49.<|bos|>One day, a boy named Tim went to the beach with his mom and
  6. story 5.47
    returns a greeting for name.<|assistant_end|><|bos|>Sara and Ben went to the beach with Mom and Dad
  7. chat 5.37
    <|assistant_start|>Sure! One day, a little boy named Tim went to the beach. He saw a
  8. story 5.32
    and songs she makes up.⏎One day, Anna goes to the park with her mom.
  9. chat 5.29
    day, a little boy named Tim went to a party. At the party, there was a
  10. story 5.28
    One day, a boy named Tim went to the big stadium with his dad.
  11. story 5.25
    .<|assistant_end|><|bos|>One day, a young boy named Tim went to the store with his mom.
  12. story 5.24
    colors and playing together.<|bos|>Once upon a time, in a big forest, there was a