Skip to content
mini-lab
Features of prelude-2

Feature #3634

Fires on “ the” (not labeled yet: read the examples)

Fires on
0.38% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 70%
  • chat 20%
  • agent 9%
  • python 1%
  • worksheet 0%

Makes the model say

park store st wrong or I g beach

Makes it not say

+ved addsaicommandemo plus counts

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.74
    43.<|assistant_end|><|bos|>One day, a boy named Tim went to the big stadi
  2. story 6.71
    time!<|assistant_end|><|bos|>One day, Tom and his mom went to the store. They saw
  3. story 6.54
    .<|assistant_end|><|bos|>One day, a young boy named Tim went to the store with his mom
  4. chat 6.46
    ?<|user_end|><|assistant_start|>One day, a pale boy named Tom went to the park. He
  5. story 6.44
    lab.<|assistant_end|><|bos|>One day, a little boy named Tim went to the park with his mom
  6. chat 6.39
    <|user_end|><|assistant_start|>Sure! One day, a little boy named Tim went to the beach. He saw
  7. chat 6.37
    short story.<|user_end|><|assistant_start|>One day, a boy named Tim went to the park. He
  8. story 6.37
    82.<|bos|>One day, a little girl named Sue went to the park. She saw
  9. story 6.37
    3.<|assistant_end|><|bos|>One day, a little girl named Mia went to the kitchen. She wanted
  10. chat 6.31
    tell me a story<|user_end|><|assistant_start|>One day, a brown dog went to the shore. He was
  11. chat 6.31
    <|user_end|><|assistant_start|>Sure! One day, a little boy named Tim went to the beach. He saw
  12. story 6.29
    her danger.<|bos|>One day, a little girl named Amy went to the park. She saw