Feature #1576

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. python 2.39
   factorial` multiplies all the numbers from 1 to n. For example, `factorial(
2. story 2.33
   day and play all night. One day,
3. python 2.24
   fact` multiplies all the numbers from 1 to n. For example, `fact(
4. story 2.18
   you because she loves you."⏎Tim played with the new ball all day. He would throw
5. story 2.17
   books in the world and a special ballroom where she could dance all night.⏎The girl
6. chat 2.16
   : calculator<|system_end|><|user_start|>Bye<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|bos|>The
7. chat 2.15
   world.<|assistant_end|><|user_start|>bye<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|bos|>Once
8. chat 2.15
   <|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|bos|><|user_start|>
9. chat 2.14
   See you later!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|user_start|>what
10. python 2.12
    fact` multiplies all the numbers from 1 to n. For example, `fact(
11. chat 2.11
    See you later!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|bos|>#
12. chat 2.1
    <|assistant_end|><|user_start|>Goodbye!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|bos|><|system_start|>