Feature #3901

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 24.72
   they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
2. story 24.1
   make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
3. chat 24.08
   that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>Who made you
4. agent 23.98
   that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
5. agent 23.94
   crazy string. She played with her new toy all day long.<|assistant_end|><|bos|><|system_start|>tools: edit
6. agent 23.93
   that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
7. chat 23.93
   played more games at the camp.<|assistant_end|><|bos|><|user_start|>Sue has
8. chat 23.91
   about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>Can you write
9. chat 23.85
   another, there will be fewer disagreements.<|bos|><|system_start|>tools: calculator
10. agent 23.84
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
11. agent 23.83
    tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
12. agent 23.83
    that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit