Feature #3793

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 1.7
   became good friends.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have
2. story 1.7
   , there was a charming festival. The festival had many fun things to do. There were games
3. chat 1.63
   .<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Goodbye! Have
4. chat 1.63
   .<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Goodbye! Have
5. worksheet 1.62
   72988⏎So 824 + 72164 =
6. story 1.61
   to pretend they were grown-ups and use the things they saw on the shelf.
7. chat 1.59
   1368.<|assistant_end|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have
8. chat 1.59
   <|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have
9. chat 1.57
   <|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have
10. chat 1.56
    numbers. Try asking me for a story!<|assistant_end|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have
11. chat 1.55
    s always had gentle results.<|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Goodbye! Have
12. chat 1.54
    `.⏎<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Goodbye! Have