Feature #1946

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 2.12
   .<|bos|>Once upon a time, there was a little girl who loved to play outside. One
2. story 2.08
   09.<|bos|>Once upon a time there was a girl who loved to help people. One
3. story 2.05
   to win the prize too!" They both played a game to see who could win the big prize
4. story 2.02
   friends.<|assistant_end|><|bos|>Once upon a time there was a girl who loved to explore. She had
5. story 1.98
   !"<|bos|>Once there was a boy, Brian, who loved to learn. Every day
6. story 1.96
   .<|assistant_end|><|bos|>Once upon a time, there was a fish who loved to swim. He lived
7. story 1.95
   ops.py`.<|assistant_end|><|bos|>Once there was a little boy who loved to play with marbles
8. chat 1.95
   <|user_end|><|assistant_start|>Once upon a time, there was a nosy bird who loved to whistle.<|assistant_end|><|bos|>
9. story 1.94
   .<|bos|>Once upon a time, there was a little girl who loved to crawl. She
10. story 1.94
    horse and the cow had a race. They wanted to see who was the fastest.⏎
11. agent 1.93
    1.<|assistant_end|><|user_start|>script.py doesn't work. Fix it.
12. story 1.92
    <|bos|>Once upon a time there was a little girl called Amy who loved to act all by herself