Feature #3140

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. agent 3.78
   how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit, gl
2. chat 3.78
   how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>
3. agent 3.55
   happy and grateful for the new friends.<|bos|><|system_start|>tools: edit, gl
4. chat 3.55
   want to have a marriage when I grow up."<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>
5. chat 3.54
   : I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>
6. agent 3.54
   to add numbers. Try asking me for a story!<|assistant_end|><|bos|><|system_start|>tools: edit, gl
7. agent 3.54
   mountain and the special symbol he pinched!<|bos|><|system_start|>tools: edit, gl
8. agent 3.54
   had dust to play with.<|assistant_end|><|bos|><|system_start|>tools: edit, gl
9. agent 3.51
   They were the best of friends, always playing and sharing.<|bos|><|system_start|>tools: edit, gl
10. agent 3.51
    , edit and fix the Python files in this project.<|assistant_end|><|bos|><|system_start|>tools: edit, gl
11. agent 3.5
    had a new toy and a good friend to play with.<|bos|><|system_start|>tools: edit, gl
12. agent 3.5
    ! Goodbye! Have a nice day.<|assistant_end|><|bos|><|system_start|>tools: edit, gl