Feature #2248

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. agent 2.08
   harness.<|system_end|><|user_start|>Create a function add in mathlib.py. It returns the sum of a
2. agent 1.95
   a function num_chars(s) to strings.py. It returns the number of characters
3. agent 1.93
   harness.<|system_end|><|user_start|>Create a function last in lists.py. It returns the last element of
4. agent 1.93
   create a function max_item in lib.py. It returns the largest number in
5. agent 1.92
   <|user_start|>add a function excite(s) to core.py. It returns s with an exclamation
6. agent 1.9
   a function average_list(nums) to lists.py. It returns the average of nums
7. agent 1.89
   harness.<|system_end|><|user_start|>Create a function initial in words.py. It returns the first letter of
8. agent 1.86
   .<|system_end|><|user_start|>Make a new file tools.py with factorial, which returns the factorial of n
9. agent 1.83
   a function first_letter(s) to lib.py. It returns the first letter of
10. agent 1.81
    a function count_items(items) to stats.py. It returns the number of items
11. agent 1.8
    a function average(a, b) to utils.py. It returns the average of a
12. agent 1.8
    a function bigger(a, b) to hello.py. It returns the bigger of two