Feature #1835

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 17.77
   they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
2. agent 17.72
   crazy string. She played with her new toy all day long.<|assistant_end|><|bos|><|system_start|>tools: edit
3. story 17.7
   make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
4. story 17.62
   very good. Tim and Sue were happy they played the game.<|assistant_end|><|bos|>Johnny was three
5. chat 17.59
   Tom went home to rest after their fun day at the beach.<|assistant_end|><|bos|><|user_start|>Add 2
6. agent 17.5
   . Mimi and Buddy were very happy and had a great day.<|assistant_end|><|bos|><|system_start|>tools: edit
7. chat 17.44
   . They had a fun day playing together with the red wagon.<|assistant_end|><|bos|><|system_start|>Answer with the
8. story 17.44
   and how to add numbers. Try asking me for a story!<|assistant_end|><|bos|>Once upon a time
9. worksheet 17.43
   more toys. And they did, for many days after that.<|assistant_end|><|bos|>73 +
10. chat 17.42
    were the best of friends, and they always helped each other.<|assistant_end|><|bos|><|system_start|>tools: calculator
11. story 17.4
    Rex and the bird became best friends and played together every day.<|assistant_end|><|bos|>Once upon a time
12. worksheet 17.4
    . They all enjoyed the warm light and had a fun day.<|assistant_end|><|bos|>Ben had 9