Feature #2898

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 9.37
   + 790<|tool_call_end|><|assistant_end|><|tool_start|>1018<|tool_end|><|assistant_start|>The answer is 1
2. chat 9.26
   31 + 81<|tool_call_end|><|assistant_end|><|tool_start|>612<|tool_end|><|assistant_start|>The answer is 6
3. chat 8.99
   31 + 81<|tool_call_end|><|assistant_end|><|tool_start|>612<|tool_end|><|assistant_start|>The answer is 6
4. chat 8.99
   + 201<|tool_call_end|><|assistant_end|><|tool_start|>1082<|tool_end|><|assistant_start|>The answer is 1
5. chat 8.95
   + 947<|tool_call_end|><|assistant_end|><|tool_start|>1917<|tool_end|><|assistant_start|>The answer is 1
6. chat 8.8
   <|arg|>expression=6 + 4<|tool_call_end|><|assistant_end|><|tool_start|>10<|tool_end|><|assistant_start|>The answer is 1
7. story 8.79
   himself again, and he learned that being the best isn't always the most important thing.
8. chat 8.77
   56<|tool_end|><|assistant_start|>The answer is 1
9. chat 8.76
   expression=68 + 1<|tool_call_end|><|assistant_end|><|tool_start|>69<|tool_end|><|assistant_start|>The answer is 6
10. chat 8.69
    95 + 88<|tool_call_end|><|assistant_end|><|tool_start|>183<|tool_end|><|assistant_start|>The answer is 1
11. chat 8.66
    7 + 750<|tool_call_end|><|assistant_end|><|tool_start|>967<|tool_end|><|assistant_start|>The answer is 9
12. chat 8.65
    + 619<|tool_call_end|><|assistant_end|><|tool_start|>1280<|tool_end|><|assistant_start|>The answer is 1