Feature #2270

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 1.77
   scared and it started to fall
2. agent 1.72
   ⏎ print(vowls("lemon"))⏎ ^^^^
3. story 1.65
   She sees Tom and the ink. She is not happy. She says, "Tom, what
4. story 1.65
   didn't want her daddy to be bored. She said, "Let's go
5. agent 1.63
   <|tool_end|><|assistant_start|>This project has 4 files:
6. story 1.61
   a pet rabbit, Cotton, and they decided to go on an adventure and explore the
7. chat 1.58
   4+61: 4+1=5, 5
8. python 1.56
   o":`.⏎⏎
9. story 1.56
   o turned to Jane and
10. story 1.56
    oes and saving
11. agent 1.55
    mean to helpers.py
12. chat 1.54
    Sam was a little boy.<|assistant_end|><|bos|>Once