Feature #1379

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 3.49
   started to fall. Luckily, a soft pile of leaves was below him. C
2. story 3.4
   ing longer and his body was becoming ligh
3. chat 3.26
   <|user_start|>What is your name?<|user_end|><|assistant_start|>My name is prelude. I'm a tiny language model
4. story 3.25
   Tommy struggled to open the lid. Just as he was beginning to
5. chat 3.24
   <|user_start|>What is your name?<|user_end|><|assistant_start|>My name is prelude. I'm a tiny language model
6. chat 3.24
   <|assistant_end|><|user_start|>Who made you?<|user_end|><|assistant_start|>My name is prelude. I'm a tiny language model
7. chat 3.23
   <|user_start|>What's your name?<|user_end|><|assistant_start|>My name is prelude. I'm a tiny language model
8. chat 3.2
   <|user_start|>What is your name?<|user_end|><|assistant_start|>My name is prelude. I'm a tiny language model
9. chat 3.18
   85.<|assistant_end|><|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can
10. chat 3.16
    <|assistant_end|><|user_start|>who made you<|user_end|><|assistant_start|>My name is prelude. I'm a tiny language model
11. chat 3.14
    <|user_start|>tell me about yourself<|user_end|><|assistant_start|>My name is prelude. I'm a tiny language model
12. chat 3.14
    this project.<|assistant_end|><|bos|><|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can