Skip to content
mini-lab
Features of prelude-2

Feature #1030

Fires on “ man” (not labeled yet: read the examples)

Fires on
0.42% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 58%
  • agent 20%
  • chat 18%
  • worksheet 2%
  • python 2%

Makes the model say

with had of boy's found! man

Makes it not say

returnreplaceAllmdreat<|tool_end|>lsax

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.37
    box together, the surprise was not broken.<|bos|>Once there was a man who was fishing
  2. story 3.34
    + 6 = 770.<|bos|>Once there was a man named Joe who loved
  3. story 3.27
    80.<|assistant_end|><|bos|>Once upon a time, there was a man who liked to sell
  4. chat 3.16
    <|system_end|><|user_start|>Write a story for me.<|user_end|><|assistant_start|>One day, a cat and a dog were
  5. chat 3.14
    <|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>One day, a cat named Kitty went to
  6. chat 3.14
    Tell me a story about a cat.<|user_end|><|assistant_start|>One day, a cat named Tom found a
  7. story 3.11
    <|think_end|>The answer is 69.<|assistant_end|><|bos|>One day, a man went to the park
  8. story 2.92
    time, there was a store. In the store, there was a man who was very patient
  9. chat 2.92
    tell me a story about a dog?<|user_end|><|assistant_start|>One day, a cat and a dog were
  10. story 2.88
    bird played together at the park every day.<|bos|>One day, a cat and a dog were
  11. chat 2.86
    Tell me a story about a cat.<|user_end|><|assistant_start|>One day, a cat named Tom found a
  12. story 2.83
    with the picture all day.<|bos|>Once upon a time there was a man who wanted to do