Feature #3955

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 5.85
   overcome any problem.<|bos|>Once upon a time there was a girl called Joy.
2. chat 5.71
   a short story<|user_end|><|assistant_start|>Once upon a time, there was a girl called Sam. She was
3. story 5.71
   calc.py`.<|assistant_end|><|bos|>Once upon a time there was a boy named Jimmy. He was
4. story 5.59
   61.<|assistant_end|><|bos|>Once upon a time there was a little girl called Amy who loved to
5. story 5.56
   help each other.<|bos|>Once upon a time there was a young boy named Bob. He was
6. story 5.51
   snow all day.<|bos|>Once upon a time, there were two friends called Ant and Be
7. story 5.48
   keeping things to yourself.<|bos|>Once there was a pretty little girl called Millie.
8. story 5.4
   lots of fun together.<|bos|>Once upon a time there was a boy named Billy. He was
9. story 5.4
   039.<|bos|>Once upon a time there was a little girl called Millie.
10. story 5.39
    one to x.<|assistant_end|><|bos|>Once upon a time there was a girl named Abigail.
11. story 5.33
    1.<|assistant_end|><|bos|>Once upon a time there was a little girl called Jenny. She wore
12. story 5.31
    675.<|bos|>Once upon a time there was a little girl named Lizzy.