Feature #664

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 1.97
   One day, a happy bee named Buzz met a pretty butterfly named Flutter.⏎
2. story 1.96
   tell short stories and add numbers.<|assistant_end|><|bos|>Lily and Ben were playing knights and dragon
3. chat 1.96
   its!"<|bos|><|user_start|>Tell me about the history of France.<|user_end|><|assistant_start|>
4. story 1.96
   had used the spear to
5. story 1.95
   creature told her that she had to find the palace before sunrise, and that
6. story 1.93
   a boy named Tim. Tim loved to play chess. He had
7. chat 1.88
   8.<|assistant_end|><|bos|><|user_start|>Tell me about the history of France.<|user_end|><|assistant_start|>
8. story 1.88
   ummy were at the beach. Joey was so excited to build sandcastles with his
9. story 1.81
   friends soon found themselves surrounded by a group of dark figures. They
10. story 1.79
    together. Tommy thinks this is the best day ever. He loves firemen.<|bos|><|system_start|>
11. agent 1.78
    a coding agent harness.<|system_end|><|user_start|>What is the capital of France?<|user_end|><|assistant_start|>
12. story 1.78
    it was a great toy for Max to play with. They played fetch with the rod