Feature #2206

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 3.69
   <|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|bos|><|user_start|>
2. chat 3.67
   bye!<|user_end|><|assistant_start|>Sure! Bye! Come back for another story soon.<|assistant_end|><|bos|><|system_start|>
3. story 3.66
   there was a little bird named Tim. Tim loved to whistle all day long. He had many
4. story 3.62
   duck named Ducky. Ducky loved to swim and play all day long.⏎One day
5. story 3.59
   , a little mouse named Jerry. They loved to play together all day long.⏎One day
6. chat 3.54
   <|bos|><|user_start|>Goodbye!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|user_start|>Add
7. chat 3.52
   See you later!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|user_start|>what
8. story 3.46
   a little bunny named Bop. Bop loved to hop all day long. One sunny day
9. chat 3.46
   <|assistant_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|user_start|>Compute
10. chat 3.46
    <|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|user_start|>Can
11. chat 3.45
    : calculator<|system_end|><|user_start|>Bye<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|bos|>The
12. chat 3.45
    <|assistant_end|><|user_start|>Goodbye!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|bos|><|system_start|>