Skip to content
mini-lab
Features of prelude-2

Feature #2720

Fires on “ to” (not labeled yet: read the examples)

Fires on
1.55% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 70%
  • chat 18%
  • agent 6%
  • python 4%
  • worksheet 1%

Makes the model say

. wanted heard a race outside together met

Makes it not say

:`])(" equalsst "!"()`MIT

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.72
    .<|assistant_end|><|bos|>One sunny day, a little girl named Mia was eager to go to the g
  2. story 2.69
    day, a boy and a girl went to play outside. They wanted to see who could wake
  3. story 2.53
    the rabbits.⏎One sunny day, Bobo and his friends decided to play a game.
  4. chat 2.48
    the sea!<|user_end|><|assistant_start|>One day, a funny fish named Bob wanted to swim in the deep
  5. story 2.46
    to play hide and seek with her friends. One day, they decided to play in the park
  6. story 2.43
    play outside with his friends. One day, Tom and his friends decided to go to a camp
  7. story 2.43
    play with me?" Bop smiled and said, "Yes, let's play together!"⏎
  8. chat 2.43
    The adventurous shrimp was excited and said, "Yes, let's play!"⏎As
  9. chat 2.41
    a kind cat named Kitty felt a strong urge to go outside and play. The sun
  10. chat 2.39
    a bunny!<|user_end|><|assistant_start|>One day, a large bunny named Bob wanted to hop to the store
  11. chat 2.38
    a story!<|user_end|><|assistant_start|>One day, a happy fish named Fin wanted to raise a big rock
  12. chat 2.38
    a time...<|user_end|><|assistant_start|>One day, a dog named Spot wanted to play. He went