Feature #1587

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 3.92
   <|user_start|>Can you tell me a story about a car?<|user_end|>
2. chat 3.87
   Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story about a bird?<|user_end|>
3. chat 3.85
   is 1001.<|assistant_end|><|user_start|>write a short story about the sea<|user_end|><|assistant_start|>
4. chat 3.83
   Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story about a fish?<|user_end|>
5. chat 3.82
   I help you today?<|assistant_end|><|user_start|>can you tell me a story about a dragon<|user_end|><|assistant_start|>
6. chat 3.8
   Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story about a bird?<|user_end|>
7. chat 3.74
   is 815.<|assistant_end|><|user_start|>Can you tell me a story about the sea?<|user_end|>
8. chat 3.74
   `initial(s)`.<|assistant_end|><|bos|><|user_start|>Can you tell me a story about a dragon?<|user_end|>
9. chat 3.72
   mini, a small and friendly assistant.<|system_end|><|user_start|>I want a story about a dog!<|user_end|>
10. chat 3.69
    many more amazing adventures together.<|bos|><|user_start|>Can you tell me a story about a bird?<|user_end|>
11. chat 3.69
    You are a helpful assistant.<|system_end|><|user_start|>Can you tell me a story about a tree?<|user_end|>
12. chat 3.66
    laptop by mini-lab.<|assistant_end|><|user_start|>Can you tell me a story about the sun?<|user_end|>