Feature #1319

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 5.57
   welcome!<|assistant_end|><|user_start|>tell me a short story<|user_end|><|assistant_start|>Once upon a time, there was
2. chat 5.5
   .<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was
3. chat 5.49
   <|assistant_end|><|bos|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was
4. chat 5.45
   <|assistant_end|><|user_start|>Tell me a story about a dragon.<|user_end|><|assistant_start|>Once upon a time, there was
5. chat 5.44
   ever after.<|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time, there was
6. chat 5.43
   .<|assistant_end|><|bos|><|user_start|>Tell me a short story.<|user_end|><|assistant_start|>Once upon a time, there was
7. chat 5.39
   .<|assistant_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was
8. chat 5.39
   .<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was
9. chat 5.39
   calculator.<|assistant_end|><|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time, there was
10. chat 5.36
    tools: calculator<|system_end|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time there was a
11. chat 5.35
    Can you tell me a story?<|user_end|><|assistant_start|>Sure! Once upon a time, there was
12. chat 5.35
    <|assistant_end|><|user_start|>I want a story about a dragon!<|user_end|><|assistant_start|>Once upon a time, there was