Feature #2705

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 1.89
   Hi!<|user_end|><|assistant_start|>Hi there! Would you like a story,
2. story 1.79
   no! There was no
3. story 1.75
   . We wanted to explore and look at the pretty flowers. Would you like to join us
4. story 1.74
   oey, I want to examine something with you. Would you help me?" Joe
5. chat 1.69
   5.<|assistant_end|><|user_start|>hey there<|user_end|><|assistant_start|>Hi there! Would you like a story,
6. agent 1.67
   pattern=**/test_*.py<|tool_call_end|><|assistant_end|><|tool_start|>test_strings.py<|tool_end|><|assistant_start|><|tool_call_start|>shell
7. chat 1.65
   add numbers.<|assistant_end|><|user_start|>Hello!<|user_end|><|assistant_start|>Hi there! Would you like a story,
8. story 1.64
   you, Thomas. I'm Millie. Would you like to help me
9. chat 1.64
   mini-lab.<|assistant_end|><|user_start|>Hello<|user_end|><|assistant_start|>Hi there! Would you like a story,
10. agent 1.64
    pattern=**/test_*.py<|tool_call_end|><|assistant_end|><|tool_start|>test_words.py<|tool_end|><|assistant_start|><|tool_call_start|>shell
11. chat 1.64
    <|assistant_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Hi there! Would you like a story,
12. chat 1.59
    <|assistant_start|>I'm sorry, I can't help with that. I only know how to tell stories