Feature #2601

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 3.99
   , there was a little ant.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Hi<|user_end|><|assistant_start|>Hi
2. chat 3.95
   tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>I want a story
3. chat 3.89
   wanted to bake a cake.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>25 +
4. chat 3.88
   was a big, wide tree.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>I need to know
5. chat 3.86
   played all day under the big rainbow.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What can you do
6. chat 3.86
   , there was a clumsy crab.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Great, thank
7. chat 3.84
   and how to add numbers. Try asking me for a story!<|assistant_end|><|user_start|>What are you good
8. chat 3.82
   , there was a big dragon.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>hey there<|user_end|>
9. chat 3.82
   and how to add numbers. Try asking me for a story!<|assistant_end|><|user_start|>Bye<|user_end|><|assistant_start|>Good
10. chat 3.81
    little girl. She loved to relax by the sea.<|assistant_end|><|user_start|>What is 4
11. chat 3.81
    did not know.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could you tell me
12. chat 3.8
    to go fast.⏎The End<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>How far away is