Skip to content
mini-lab
Features of prelude-2

Feature #1807

Fires on “ walk” (not labeled yet: read the examples)

Fires on
0.48% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 62%
  • story 21%
  • chat 9%
  • worksheet 6%
  • python 2%

Makes the model say

s.main is insidestrings longing

Makes it not say

he gone!")bye])) newred total

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.26
    ?<|user_end|><|assistant_start|>One day, a little boy named Tim went for a walk in the park.
  2. chat 3.21
    park!<|user_end|><|assistant_start|>One day, a boy named Tim went for a walk. He liked
  3. chat 3.17
    Tell me a story.<|user_end|><|assistant_start|>One day, Tom went for a walk in the park.
  4. chat 3.09
    .<|user_end|><|assistant_start|>One day, a little girl named Lucy went for a walk. The sun was
  5. story 3.07
    ?<|assistant_end|><|bos|>One day, a big, serious bear went for a walk in the woods.
  6. chat 3.02
    .<|user_end|><|assistant_start|>One day, a little girl named Mia went for a walk. She saw a
  7. chat 3.02
    .<|user_end|><|assistant_start|>One day, a little girl named Mia went for a walk. She saw
  8. story 3.0
    a little boy named Tim and his dog, Spot, went for a walk. They played in
  9. story 2.98
    .<|assistant_end|><|bos|>One day, a little boy named Tim went for a walk with his mom.
  10. chat 2.98
    <|user_end|><|assistant_start|>One day, a mild cat named Tom went for a walk.<|assistant_end|><|bos|>Once
  11. story 2.98
    some numbers to add?<|assistant_end|><|bos|>One day, Tim went for a walk with his mom.
  12. chat 2.96
    <|user_end|><|assistant_start|>One day, a large dog with soft fur went for a walk. The dog