Feature #2184
Fires on “ ancient” (not labeled yet: read the examples)
- Fires on
- 0.55% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 65%
- story 17%
- worksheet 11%
- chat 6%
- python 1%
Makes the model say
ter cat size treek It yes ashamed
Makes it not say
<|bos|>⏎ : `],⏎ achedTEXT
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 2.28about a tree.<|user_end|><|assistant_start|>Once upon a time, there was an ancient tree in a big
-
story 2.19and they were happy.<|bos|>Once upon a time, there was an old oyster. The old
-
chat 2.13about a fish.<|user_end|><|assistant_start|>Once upon a time, there was an ancient fish. The fish
-
chat 2.05about a cat?<|user_end|><|assistant_start|>Once upon a time, there was an old cat.<|assistant_end|><|bos|>
-
story 2.02SE"`.⏎<|bos|>Once upon a time, there was a big, bossy rabbit named Bob.
-
chat 2.0about the sea?<|user_end|><|assistant_start|>Once upon a time, there was a fat crab. The
-
story 1.991382<|bos|>Once upon a time, there was an ugly frog. He lived
-
story 1.973.<|assistant_end|><|bos|>Once upon a time, there was a big, bossy bear. The bear
-
story 1.94<|think_end|>297<|assistant_end|><|bos|>Once upon a time, there was an elderly lady named Bea
-
story 1.93short stories and add numbers.<|assistant_end|><|bos|>Once upon a time a very ancient flag waved in the
-
story 1.92Tom went for a walk.<|assistant_end|><|bos|>Once upon a time, a fat cat named Tom found
-
story 1.9py`, line 1.<|assistant_end|><|bos|>Once upon a time, a bald man named Tom loved