Feature #2167

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 2.71
   6.<|assistant_end|><|bos|>Once upon a time, there was a boy named Tim. He liked to
2. story 2.59
   4.<|bos|>Once upon a time, there was a young boy named Tim. Tim loved to
3. story 2.57
   .<|assistant_end|><|bos|>Once upon a time, there was a little boy named Tim. Tim was a
4. story 2.56
   big fish surfing together.<|bos|>Once, there was a boy named Tim. Tim had a
5. story 2.55
   in.<|bos|>Once upon a time, there was a little boy named Tim. He liked to
6. story 2.55
   amazing.<|bos|>Once upon a time, there was a little boy named Tim. Tim loved to
7. story 2.54
   9.<|bos|>Once upon a time, there was a little boy named Tim. He lived in
8. story 2.54
   3.<|assistant_end|><|bos|>Once upon a time, there was a boy named Tim. Tim was a
9. chat 2.52
   .<|user_end|><|assistant_start|>Once upon a time, there was a little boy named Tim. Tim loved
10. story 2.51
    <|assistant_end|><|bos|>Once upon a time, there was a pale boy named Tim. Tim loved to
11. story 2.48
    time, there was a little boy named Tim. Tim was very
12. story 2.47
    `.<|assistant_end|><|bos|>Once upon a time, there was a little boy named Tim. Tim was troubled