Feature #565

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 6.56
   and add numbers.<|assistant_end|><|bos|>Once upon a time, in a small town, there lived a
2. story 6.51
   of the nice day.<|bos|>Once upon a time, in a small town, there lived a
3. story 6.43
   show everyone back home!<|bos|>Once upon a time, in a small village, there was an
4. story 6.39
   74.<|assistant_end|><|bos|>Once upon a time, in a small town, there was a
5. story 6.38
   played happily ever after.<|bos|>Once upon a time, in a small town, there was a
6. story 6.36
   help you today?<|assistant_end|><|bos|>Once upon a time, in a small town, there was a
7. story 6.34
   14.<|assistant_end|><|bos|>Once upon a time, in a peaceful little town, there was a
8. story 6.33
   're welcome!<|assistant_end|><|bos|>Once upon a time, in a big green forest, there lived a
9. chat 6.29
   a story!<|user_end|><|assistant_start|>Once upon a time, in a cheerful forest, there lived a
10. story 6.21
    went back to bed.<|bos|>Once upon a time, in a small town, there was a
11. chat 6.21
    about a tree?<|user_end|><|assistant_start|>Once upon a time, in a small town, there was a
12. story 6.2
    Tim was happy again.<|bos|>Once upon a time, in a small town, there was a