Feature #3487

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. agent 2.55
   rename the function mean to my_mean.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
2. agent 2.55
   x)`.<|assistant_end|><|user_start|>Set LIMIT to 7<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
3. agent 2.53
   [8, 6, 2].<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
4. agent 2.49
   ^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
5. agent 2.42
   new_sub_one instead of sub_one<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
6. agent 2.42
   <|user_start|>"use 8 for SIZE."<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
7. agent 2.41
   .<|assistant_end|><|user_start|>Where is add_one defined?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
8. agent 2.41
   ^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
9. agent 2.41
   ^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
10. agent 2.4
    ^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
11. agent 2.4
    ^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
12. agent 2.4
    .<|system_end|><|user_start|>How does how_many work?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=