Feature #3455

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. agent 4.96
   .py which prints It works! and run it.<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path
2. agent 4.93
   coding agent harness.<|system_end|><|user_start|>"Run run.py."<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
3. agent 4.86
   .<|system_end|><|user_start|>"Execute run.py"<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
4. agent 4.85
   .py that prints "Good morning" and run it please<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path
5. agent 4.82
   .<|system_end|><|user_start|>Run run.py and fix the error.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
6. agent 4.79
   test_items.py fails, please fix it.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
7. agent 4.75
   for WORD in hello.py and run hello.py.<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=
8. agent 4.73
   .<|system_end|><|user_start|>Run run.py and fix the error.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
9. agent 4.73
   py that prints "Welcome!", then run it.<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path
10. agent 4.73
    py that prints Hello, Zoe! and run it<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path
11. agent 4.68
    py which prints Hello, Leo! and run it."<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path
12. agent 4.66
    .py that prints It works! and run it.<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path