Feature #3518

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 2.32
   old lady was happy.<|bos|>Once upon a time, there was a
2. story 2.23
   numbers. Try asking me for a story!<|assistant_end|><|bos|>Once upon a time, in a small
3. chat 2.2
   tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a
4. chat 2.18
   an you tell me a story about a dragon<|user_end|><|assistant_start|>Once upon a time, there was a
5. story 2.15
   happy too. They all went back to bed.<|bos|>Once upon a time, in a small
6. story 2.15
   can only tell short stories and add numbers.<|assistant_end|><|bos|>Once upon a time, in a small
7. chat 2.14
   <|user_start|>Write a short story about a princess.<|user_end|><|assistant_start|>Once upon a time, there was a
8. story 2.13
   is 70.<|assistant_end|><|bos|>Once upon a time, there was a
9. story 2.13
   And they all lived happily in their hive.<|bos|>Once upon a time, there was a
10. story 2.12
    Sam was a little boy.<|assistant_end|><|bos|>Once upon a time, there was a
11. story 2.12
    <|assistant_start|>The answer is 86.<|assistant_end|><|bos|>Once upon a time, there was a
12. story 2.11
    to show everyone back home!<|bos|>Once upon a time, in a small