Feature #2708

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 7.04
   <|system_end|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time there was a little girl named
2. story 6.91
   answer is 261.<|assistant_end|><|bos|>Once upon a time there was a little girl called
3. story 6.86
   answer is 176.<|assistant_end|><|bos|>Once upon a time there was a bear who loved
4. chat 6.85
   want a story about a princess!<|user_end|><|assistant_start|>Once upon a time there was a princess. She
5. chat 6.85
   story!<|user_end|><|assistant_start|>Once upon a time there was a boy.
6. story 6.84
   to tell stories and add numbers.<|assistant_end|><|bos|>Once upon a time there was a beautiful forest,
7. story 6.82
   happy and had a great time.<|assistant_end|><|bos|>Once upon a time there was a sleepy squirrel.
8. story 6.79
   answer is 139.<|assistant_end|><|bos|>Once upon a time there was a little girl called
9. story 6.79
   answer is 257.<|assistant_end|><|bos|>Once upon a time there was an old man.
10. chat 6.76
    <|user_start|>Write a story for me.<|user_end|><|assistant_start|>Once upon a time there was a boy.<|assistant_end|>
11. story 6.74
    The answer is 10.<|assistant_end|><|bos|>Once upon a time there was a monkey, named
12. story 6.71
    answer is 436.<|assistant_end|><|bos|>Once upon a time there was a big, dangerous