Feature #1223

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 3.34
   his friend, Birdy
2. story 3.34
   his birthday cake. His
3. story 3.34
   his mother told him that
4. story 3.34
   his sack.⏎The
5. story 3.34
   his new friend, Sam
6. chat 3.14
   your name<|user_end|><|assistant_start|>My
7. story 3.14
   your egg, and I
8. story 3.1
   Tom's ice-cream fell
9. story 3.08
   ?" His mom looked at the
10. chat 2.94
    their feet.<|assistant_end|><|user_start|>What's your name?<|user_end|><|assistant_start|>My name is prelude. I'm
11. chat 2.89
    treat you.<|bos|><|user_start|>What is your name?<|user_end|><|assistant_start|>My name is prelude. I'm
12. agent 2.85
    tiny language model trained from scratch on a laptop