Feature #1551

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. python 6.36
   def head(items):⏎
2. python 6.13
   def tail(items):⏎ return items[-1]⏎⏎⏎def smallest(nums):⏎
3. agent 5.83
   % b == 0⏎⏎⏎def vowels(s):⏎
4. python 5.78
   def head(items):⏎ return items[0]⏎⏎⏎def biggest(nums):⏎
5. python 5.74
   x):⏎ return x % 2 == 1⏎⏎⏎def times(a, b
6. agent 5.64
   def tail<|tool_call_end|><|assistant_end|><|tool_start|>Found
7. python 5.61
   def half(x):⏎ return x // 2⏎⏎⏎def negate(x):⏎
8. python 5.57
   def half(x):⏎ return x // 2⏎⏎⏎def odd(x):⏎
9. python 5.57
   def initial(s):⏎ return s[0]⏎⏎⏎def echo(s, n
10. python 5.54
    ⏎⏎⏎def square(x):⏎
11. agent 5.52
    newString= return b⏎⏎⏎def positive(x):⏎
12. python 5.52
    1⏎⏎⏎def even(x):⏎