Feature #2147

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 2.33
   numbers, step by step or with a calculator.<|assistant_end|><|bos|><|user_start|>Tell me a story.<|user_end|>
2. chat 2.31
   their friends. And they all lived happily ever after.<|bos|><|user_start|>Tell me a story.<|user_end|>
3. chat 2.28
   145.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Tell me a fact about space
4. chat 2.27
   numbers, step by step or with a calculator.<|assistant_end|><|bos|><|user_start|>Tell me a short story.
5. chat 2.27
   But he did learn an important lesson in being patient.<|bos|><|user_start|>Tell me the latest
6. chat 2.27
   numbers.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Tell me a story about a
7. chat 2.26
   + 815 = 819.<|bos|><|user_start|>Tell me about the hist
8. chat 2.26
   : I can only tell short stories and add numbers.<|assistant_end|><|user_start|>Tell me about yourself.<|user_end|>
9. chat 2.25
   you like a story, or some numbers to add?<|assistant_end|><|user_start|>Tell me a short story.
10. chat 2.25
    was a sailor.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Tell me a story.<|user_end|>
11. chat 2.23
    , thanks!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>Tell me a story about a
12. chat 2.22
    to do something to help somebody in need.<|bos|><|user_start|>Tell me a story about a