Feature #1774

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 22.07
   they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
2. story 22.0
   make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
3. agent 21.95
   on, they had many fun adventures.<|assistant_end|><|bos|><|system_start|>tools: edit
4. chat 21.76
   could have with her toys. And they all lived happily ever after.<|bos|><|system_start|>tools: calculator
5. chat 21.74
   that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>Who made you
6. chat 21.72
   , create, edit and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>Hey<|user_end|><|assistant_start|>
7. agent 21.72
   that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
8. agent 21.72
   that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
9. chat 21.69
   played more games at the camp.<|assistant_end|><|bos|><|user_start|>Sue has
10. story 21.68
    danced together. They were all happy and had a great time.<|assistant_end|><|bos|>Once upon a time
11. agent 21.6
    crazy string. She played with her new toy all day long.<|assistant_end|><|bos|><|system_start|>tools: edit
12. agent 21.59
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit