Feature #3913

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 18.9
   they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
2. chat 18.89
   that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>Who made you
3. story 18.73
   that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Once upon a time
4. agent 18.7
   that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
5. chat 18.69
   that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>
6. python 18.68
   that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|># demo.py
7. agent 18.67
   that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
8. python 18.66
   that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|># script.py
9. agent 18.65
   tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
10. chat 18.65
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>Answer in one
11. worksheet 18.65
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Lily has 3
12. agent 18.64
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit