Feature #1207

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. agent 2.82
   text.py⏎test_text.py<|tool_end|><|assistant_start|>This project has 3 Python files:
2. agent 2.75
   py⏎greetings.py⏎main.py<|tool_end|><|assistant_start|>This project has 3 Python files:
3. agent 2.74
   test_ops.py⏎ops.py<|tool_end|><|assistant_start|>This project has 2 Python files:
4. agent 2.66
   test_calc.py⏎calc.py<|tool_end|><|assistant_start|>This project has 2 Python files:
5. agent 2.63
   test_core.py⏎main.py<|tool_end|><|assistant_start|>This project has 3 Python files:
6. agent 2.63
   core.py⏎math_utils.py<|tool_end|><|assistant_start|>This project has 3 Python files:
7. agent 2.58
   stats.py⏎test_stats.py<|tool_end|><|assistant_start|>This project has 2 Python files:
8. agent 2.58
   arith.py⏎test_arith.py<|tool_end|><|assistant_start|>This project has 2 Python files:
9. agent 2.57
   py⏎text.py⏎main.py<|tool_end|><|assistant_start|>This project has 3 Python files:
10. agent 2.56
    greetings.py⏎test_greetings.py<|tool_end|><|assistant_start|>This project has 3 files: `
11. agent 2.56
    test_listlib.py⏎listlib.py<|tool_end|><|assistant_start|>This project has 3 Python files:
12. agent 2.56
    py⏎strings.py⏎tools.py<|tool_end|><|assistant_start|>This project has 3 Python files: