Feature #64

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. agent 4.93
   Run the tests in test_number_utils.py"<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
2. agent 4.71
   <|user_start|>"Run the tests in test_utils.py."<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
3. agent 4.68
   .<|system_end|><|user_start|>explain product from number_utils.py<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=
4. agent 4.63
   <|system_end|><|user_start|>Run the tests in test_utils.py.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
5. agent 4.62
   max(nums)<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path
6. agent 4.61
   .<|system_end|><|user_start|>Run the tests in test_lib.py<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
7. agent 4.59
   k<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path
8. agent 4.58
   harness.<|system_end|><|user_start|>Execute app.py.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
9. agent 4.58
   <|system_end|><|user_start|>run the tests in test_arith.py.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
10. agent 4.54
    .<|system_end|><|user_start|>"Execute run.py"<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
11. agent 4.53
    Run the tests in test_math_utils.py.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
12. agent 4.52
    <|user_start|>"The tests are failing, fix the bug please"<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>