Feature #2888

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 10.56
   ways to remember important things, so we don't let others down.<|bos|>Once upon a time
2. agent 10.4
   careful when sailing and to not go out in bad weather.<|bos|><|system_start|>tools: edit
3. chat 10.39
   another, there will be fewer disagreements.<|bos|><|system_start|>tools: calculator
4. story 10.39
   , edit and fix the Python files in this project.<|assistant_end|><|bos|>Once upon a time
5. agent 10.36
   7, 17<|think_end|>The answer is 17.<|assistant_end|><|bos|><|system_start|>tools: edit
6. agent 10.36
   7, 78<|think_end|>The answer is 78.<|assistant_end|><|bos|><|system_start|>tools: edit
7. story 10.34
   make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
8. story 10.33
   6, 67<|think_end|>The answer is 67.<|assistant_end|><|bos|>One day, a
9. chat 10.32
   172<|think_end|>The answer is 172.<|assistant_end|><|bos|><|system_start|>tools: calculator
10. chat 10.32
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>Who made you
11. chat 10.31
    , create, edit and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>Hey<|user_end|><|assistant_start|>
12. python 10.31
    , and he used his strength to help others.<|bos|>`mean_list