Feature #3447

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. python 5.97
   sum(nums) / len(nums)⏎⏎⏎def magnitude(x):⏎ if x
2. python 5.92
   (x):⏎ return x // 2⏎⏎⏎def odd(x):⏎ return x
3. python 5.78
   s):⏎ return s + "!"⏎⏎⏎def add_one(x):⏎ return x
4. python 5.71
   head(items)`.<|assistant_end|><|bos|># mathlib.py⏎def fact(n):⏎ result =
5. python 5.66
   sum(nums) / len(nums)⏎⏎⏎def odd(x):⏎ return x
6. python 5.65
   (s):⏎ return s[0]⏎⏎⏎def positive(x):⏎ return x
7. python 5.58
   items, x):⏎ return x in items⏎⏎⏎def first(items):⏎ return items
8. python 5.58
   b):⏎ return a ** b⏎⏎⏎def sub_one(x):⏎ return x
9. python 5.56
   x):⏎ return x * x⏎⏎⏎def sub_one(x):⏎ return x
10. python 5.56
    were happy and safe.<|bos|># tools.py⏎def first(items):⏎ return items
11. agent 5.52
    n * 2 for n in nums]⏎⏎⏎def first(items):⏎ return items
12. python 5.52
    b):⏎ return a * b⏎⏎⏎def add_one(x):⏎ return x