Feature #2699

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 6.16
   time, in a small town, there lived a cute dog named Max. Max was a hero
2. story 5.97
   time, in a small town, there lived a little boy named Tom. Tom liked to organ
3. story 5.95
   .<|bos|>Once upon a time, there was a little dog named Max. Max was very ent
4. story 5.9
   ⏎<|bos|>Once upon a time, there was a little dog named Max. Max lived in a
5. story 5.87
   <|assistant_end|><|bos|>Once upon a time, there was a little squirrel named Sam. Sam loved to play
6. story 5.8
   <|assistant_end|><|bos|>Once upon a time, there was a little girl named Mia. Mia loved her toy
7. story 5.77
   .<|bos|>Once upon a time, there was a little dog named Max. Max liked to run
8. story 5.73
   time, in a big jungle, there lived a little monkey named Momo. Momo loved to build
9. story 5.72
   <|assistant_end|><|bos|>Once upon a time, there was a small cat named Tom. Tom liked to run
10. story 5.71
    <|assistant_end|><|bos|>Once upon a time, there was a little dog named Max. Max loved to play
11. story 5.7
    <|bos|>Once upon a time, there was a little girl named Sue. She loved to play
12. story 5.7
    a time, in a small house, lived a little girl named Lily. Lily loved to write