Feature #856
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.21% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 35%
- agent 31%
- story 28%
- python 6%
- worksheet 0%
Makes the model say
of lotw` were voice tried please
Makes it not say
27 them8 happyERri3
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 2.29<|assistant_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
-
chat 2.19football.<|assistant_end|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
-
story 2.17a big hug. The ball made him so happy.⏎At the end of the day,
-
chat 2.16<|assistant_end|><|user_start|>hey there<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
-
chat 2.09.<|assistant_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
-
chat 2.05Hi!<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
-
chat 2.01.<|assistant_end|><|bos|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
-
chat 2.0calculator<|system_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
-
chat 1.98.<|assistant_end|><|bos|><|user_start|>Hi<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
-
chat 1.96calculator.<|assistant_end|><|user_start|>Hi<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
-
chat 1.955.<|assistant_end|><|user_start|>Hi<|user_end|><|assistant_start|>Hi there! Would you like a story, or some
-
chat 1.95<|user_start|>Hi<|user_end|><|assistant_start|>Sure! Hi there! Would you like a story, or some