Skip to content
mini-lab
Features of prelude-2

Feature #2809

Fires on “ went” (not labeled yet: read the examples)

Fires on
0.66% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 86%
  • story 8%
  • chat 6%
  • python 0%
  • worksheet 0%

Makes the model say

out intog Whata underOneet

Makes it not say

's though Sue is words day cutIt

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.33
    a short story about the sea<|user_end|><|assistant_start|>One day, a seal went for a jog
  2. story 2.21
    help you today?<|assistant_end|><|bos|>One day, a big, serious bear went for a walk in
  3. chat 2.13
    want a story about the sun!<|user_end|><|assistant_start|>One day, a hero went out for a walk
  4. story 2.08
    lots of fun.<|assistant_end|><|bos|>One day, a cat named Jazz went for a walk.
  5. chat 2.08
    Tell me a short story.<|user_end|><|assistant_start|>One day, a painter went to the store.
  6. story 2.07
    never she was feeling sad.<|bos|>One day, a seal went for a walk by
  7. chat 2.06
    Tell me a short story.<|user_end|><|assistant_start|>One day, a painter went to the store.
  8. chat 2.06
    story!<|user_end|><|assistant_start|>One day, a wild cat with a long tail went to a big tree
  9. story 2.0
    is 53.<|assistant_end|><|bos|>One day, a boy named Peter went to the park.
  10. story 1.97
    7⏎2⏎<|bos|>One day, a worried little alligator went to the forest.
  11. chat 1.96
    <|user_start|>Tell me a story.<|user_end|><|assistant_start|>One day, a furry dog went for a walk.
  12. chat 1.96
    <|assistant_start|>Sure! One day, a big ostrich named Ollie went for a walk.