Skip to content
mini-lab
Features of prelude-2

Feature #2184

Fires on “ ancient” (not labeled yet: read the examples)

Fires on
0.55% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 65%
  • story 17%
  • worksheet 11%
  • chat 6%
  • python 1%

Makes the model say

ter cat size treek It yes ashamed

Makes it not say

<|bos|>⏎ : `],⏎ achedTEXT

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.28
    about a tree.<|user_end|><|assistant_start|>Once upon a time, there was an ancient tree in a big
  2. story 2.19
    and they were happy.<|bos|>Once upon a time, there was an old oyster. The old
  3. chat 2.13
    about a fish.<|user_end|><|assistant_start|>Once upon a time, there was an ancient fish. The fish
  4. chat 2.05
    about a cat?<|user_end|><|assistant_start|>Once upon a time, there was an old cat.<|assistant_end|><|bos|>
  5. story 2.02
    SE"`.⏎<|bos|>Once upon a time, there was a big, bossy rabbit named Bob.
  6. chat 2.0
    about the sea?<|user_end|><|assistant_start|>Once upon a time, there was a fat crab. The
  7. story 1.99
    1382<|bos|>Once upon a time, there was an ugly frog. He lived
  8. story 1.97
    3.<|assistant_end|><|bos|>Once upon a time, there was a big, bossy bear. The bear
  9. story 1.94
    <|think_end|>297<|assistant_end|><|bos|>Once upon a time, there was an elderly lady named Bea
  10. story 1.93
    short stories and add numbers.<|assistant_end|><|bos|>Once upon a time a very ancient flag waved in the
  11. story 1.92
    Tom went for a walk.<|assistant_end|><|bos|>Once upon a time, a fat cat named Tom found
  12. story 1.9
    py`, line 1.<|assistant_end|><|bos|>Once upon a time, a bald man named Tom loved