Feature #2204

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 5.08
   Try asking me for a story!<|assistant_end|><|bos|>Once upon a time, there was a little boy
2. story 5.07
   , or some numbers to add?<|assistant_end|><|bos|>Once upon a time, there was a little girl
3. story 5.04
   to tell stories and add numbers.<|assistant_end|><|bos|>Once upon a time, there were two friends called
4. story 5.03
   sharing with others can make everyone happy.<|bos|>Once upon a time, there was a little dog
5. story 5.02
   to tell stories and add numbers.<|assistant_end|><|bos|>Once upon a time, there was a small bird
6. story 5.01
   , 39<|think_end|>39<|assistant_end|><|bos|>Once upon a time, there was a girl named
7. story 5.0
   tell short stories and add numbers.<|assistant_end|><|bos|>Once upon a time, there was a little green
8. story 4.98
   the Python files in this project.<|assistant_end|><|bos|>Once upon a time, there was a nosy bee
9. story 4.98
   , but not more important than family.<|bos|>Once upon a time, there was a restless
10. story 4.98
    diary before planning a big meal.<|bos|>Once upon a time, there were two friends,
11. chat 4.96
    <|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time, there was a dog.
12. story 4.96
    the Python files in this project.<|assistant_end|><|bos|>Once upon a time, there was a little squirrel