Skip to content
mini-lab
Features of prelude-2

Feature #1515

Fires on “ walk” (not labeled yet: read the examples)

Fires on
0.59% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 68%
  • chat 22%
  • agent 6%
  • python 2%
  • worksheet 2%

Makes the model say

==? example0 walk slowly walking<|user_start|>

Makes it not say

secret], not onlyckedAnd off So

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.75
    cat")⏎"tac"⏎<|bos|>Jimmy was walking in the park.
  2. story 3.56
    apples.<|bos|>One day, a little girl named Mia went for a walk. She saw a
  3. story 3.53
    answer is 136.<|assistant_end|><|bos|>Max and his mum were walking to the park on
  4. chat 3.48
    .<|bos|><|user_start|>Once upon a time...<|user_end|><|assistant_start|>Billy was walking in the park on
  5. story 3.47
    3.<|bos|>One day, a little boy named Tim went for a walk. The air was
  6. story 3.46
    6014.<|bos|>George and his Dad were walking along the golf
  7. chat 3.44
    .<|user_end|><|assistant_start|>One day, a little girl named Lucy went for a walk. The sun was
  8. story 3.4
    He was so curious and liked to guess things. One day he was walking in the woods.
  9. story 3.4
    some numbers to add?<|assistant_end|><|bos|>One day, Tim went for a walk with his mom.
  10. story 3.4
    `.⏎<|bos|>One day, a little boy named Tim went for a walk with his mom.
  11. chat 3.38
    .<|user_end|><|assistant_start|>One day, a little girl named Mia went for a walk. She saw a
  12. chat 3.38
    ?<|user_end|><|assistant_start|>One day, a little boy named Tim went for a walk in the park.