Feature #1826

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. agent 2.63
   [1]<|arg|>newString
2. python 2.47
   ⏎⏎```python⏎def head(items):⏎ return items[0]⏎```⏎
3. python 2.43
   (WORD))⏎⏎$ python3 script.py⏎[0]⏎pizza
4. agent 2.41
   in nums]⏎⏎⏎def first(items):⏎ return items[0]<|tool_call_end|><|assistant_end|><|tool_start|>
5. python 2.4
   for n in nums]⏎⏎$ python3 app.py⏎[0, 1
6. python 2.38
   0]⏎⏎⏎def head(items):⏎ return items[0]⏎⏎⏎def
7. python 2.35
   5, 5]))⏎⏎$ python3 run.py⏎[4, 1
8. python 2.32
   2 == 0]⏎⏎$ python3 main.py⏎[8, 6
9. python 2.27
   (nums)⏎⏎⏎def first(items):⏎ return items[0]⏎⏎⏎def
10. python 2.24
    [-1]⏎⏎⏎def initial(s):⏎ return s[0]⏎⏎⏎def
11. python 2.24
    # lists.py⏎def head(items):⏎ return items[0]⏎⏎⏎def
12. python 2.24
    items[0]` with `