Feature #1031

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 2.09
   ?" Lucy and Tom said
2. story 2.09
   ?"⏎Tom nodded.
3. story 2.09
   ?" he asked. His
4. story 2.09
   ?" Billy was excited and
5. story 2.09
   ?" His mom looked at
6. story 2.09
   ?"⏎The little boy
7. story 1.98
   save the bird?" The car said,
8. story 1.92
   eked out to see what it was.⏎"Hello!" said a tiny ant named Andy
9. story 1.9
   227, you get 96325.<|bos|>Alice was a gift
10. chat 1.89
    i.⏎"Hi, I am Gigi the grape!" said Gigi
11. chat 1.88
    files in this project.<|assistant_end|><|bos|><|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|>
12. agent 1.86
    3 test_math_utils.py<|tool_call_end|><|assistant_end|><|tool_start|>all tests passed⏎<|tool_end|><|assistant_start|>`test