Feature #2406
Fires on “.” (not labeled yet: read the examples)
- Fires on
- 1.00% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 73%
- story 17%
- agent 8%
- python 1%
- worksheet 0%
Makes the model say
It a plus uponOnce numbers<|bos|>One
Makes it not say
fell toys goneb things return them Sometimes
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 4.98in one short sentence.<|system_end|><|user_start|>Tell me a story about a cat.<|user_end|><|assistant_start|>One day
-
chat 4.94in one short sentence.<|system_end|><|user_start|>Tell me a story about a cat.<|user_end|><|assistant_start|>One day
-
chat 4.7body in need.<|bos|><|user_start|>Tell me a story about a fish.<|user_end|><|assistant_start|>Once upon
-
chat 4.67tests pass now.<|assistant_end|><|bos|><|user_start|>Tell me a story about a bird.<|user_end|><|assistant_start|>Once upon
-
chat 4.67all tests passed.<|assistant_end|><|bos|><|user_start|>Write a short story about a bird.<|user_end|><|assistant_start|>One day
-
chat 4.65about the war and were happy.<|bos|><|user_start|>Write a story for me.<|user_end|><|assistant_start|>One day
-
chat 4.63<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>One day
-
chat 4.61kindness of those around him.<|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon
-
chat 4.61stories and add numbers.<|assistant_end|><|user_start|>Tell me a story about a cat.<|user_end|><|assistant_start|>One day
-
chat 4.6and played until the sun went down.<|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon
-
chat 4.57+ b⏎```⏎<|bos|><|user_start|>Tell me a story about a bird.<|user_end|><|assistant_start|>Once upon
-
chat 4.57I help you today?<|assistant_end|><|user_start|>I want a story about a bird!<|user_end|><|assistant_start|>Once upon