Feature #2383

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. python 2.54
   12⏎```<|assistant_end|><|bos|># test_helpers.py⏎from helpers import first, increment
2. python 2.49
   + name + "!"⏎⏎# test_lib.py⏎from lib import final_letter
3. python 2.44
   len(items)⏎⏎# test_lib.py⏎from lib import min_of
4. python 2.43
   s[::-1]⏎⏎# test_lib.py⏎from lib import echo, flip
5. python 2.42
   <|think_end|>910<|assistant_end|><|bos|># test_textlib.py⏎from textlib import echo, length
6. python 2.4
   items[0]⏎⏎# test_helpers.py⏎from helpers import first⏎⏎
7. python 2.4
   6 = 16<|bos|># test_helpers.py⏎from helpers import add_all
8. python 2.37
   ⏎hello⏎```<|assistant_end|><|bos|># test_tools.py⏎from tools import whisper⏎⏎
9. python 2.33
   return s + "!"⏎⏎# test_helpers.py⏎from helpers import exclaim⏎⏎
10. python 2.33
    )⏎-3⏎<|bos|># test_calc.py⏎from calc import min_of
11. python 2.29
    all(NUMBERS))⏎⏎# test_tools.py⏎from tools import add_all
12. python 2.28
    json"⏎}⏎⏎# test_tools.py⏎from tools import flip, add