Feature #1954

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 3.09
   <|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a boat
2. chat 2.79
   0<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about the sea
3. chat 2.79
   with "Sure!".<|system_end|><|user_start|>I want a story!<|user_end|><|assistant_start|>
4. chat 2.78
   world.<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a bunny
5. chat 2.71
   `.⏎<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a cake
6. chat 2.71
   9<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about the sea
7. story 2.69
   the big ball. They were so happy to have found something new to play with.⏎As
8. chat 2.65
   . He was jumping from tree to tree.<|assistant_end|><|user_start|>I want a story about a princess
9. chat 2.65
   `.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a dog
10. chat 2.62
    .<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about the sea
11. chat 2.62
    <|user_start|>thanks<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|user_start|>I want a story about the park
12. chat 2.6
    tell short stories and add numbers.<|assistant_end|><|user_start|>I want a story about a cat