Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #644

Fires on “ walk” (not labeled yet: read the examples)

Fires on
0.22% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 75%
  • chat 13%
  • worksheet 7%
  • agent 4%
  • python 1%

Makes the model say

. project explore?"ful on about try

Makes it not say

he=**/<|think_start|> last mini], passesbye

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.2
    John who lived by the sea. One day, John went for a walk by the beach and
  2. story 2.13
    ?<|assistant_end|><|bos|>One day, a big, serious bear went for a walk in the woods.
  3. story 2.08
    name was Hank. One day, he decided to go for a walk in search of adventure
  4. chat 2.07
    a bunny.<|user_end|><|assistant_start|>One day, Poppy the bunny went for a walk.<|assistant_end|><|bos|><|system_start|>
  5. chat 2.07
    <|user_end|><|assistant_start|>One day, a large dog with soft fur went for a walk. The dog
  6. story 2.06
    , as he was walking through a field, he stopped to take a rest. He lay down
  7. story 2.04
    loved to play outside. One day, she decided to go for a walk in the woods.
  8. chat 2.02
    a bunny.<|user_end|><|assistant_start|>One day, Poppy the bunny went for a walk.<|assistant_end|><|bos|>How
  9. story 2.01
    away the day.⏎One day, Fluffy decided to go for a walk around the yard.
  10. story 1.99
    .<|assistant_end|><|bos|>One day, a cat named Jazz went for a walk. Jazz liked
  11. chat 1.98
    a story.<|user_end|><|assistant_start|>One day, a furry dog went for a walk.<|assistant_end|><|bos|>```
  12. chat 1.98
    ?<|user_end|><|assistant_start|>One day, a little boy named Tim went for a walk in the park.