Feature #1539

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. agent 2.9
   is 111.<|assistant_end|><|bos|><|system_start|>tools: edit, glob
2. agent 2.87
   is 97.<|assistant_end|><|bos|><|system_start|>tools: edit, glob
3. agent 2.8
   .<|assistant_end|><|bos|><|system_start|>tools: edit, glob
4. agent 2.77
   96.<|assistant_end|><|bos|><|system_start|>tools: edit, glob
5. agent 2.76
   much.<|bos|><|system_start|>tools: edit, glob
6. agent 2.75
   !<|assistant_end|><|bos|><|system_start|>tools: edit, glob
7. agent 2.74
   325<|assistant_end|><|bos|><|system_start|>tools: edit, glob
8. agent 2.73
   _case(s)`.<|assistant_end|><|bos|><|system_start|>tools: edit, glob
9. agent 2.73
   b.<|assistant_end|><|bos|><|system_start|>tools: edit, glob
10. chat 2.72
    (nums)`.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Tell
11. chat 2.71
    ant capabilities<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Find
12. agent 2.7
    I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit, glob