Feature #268

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 6.76
   they went home with big smiles on their faces.<|bos|><|user_start|>Could you tell me what 8
2. chat 6.73
   anymore. The big, mean monster had won.<|bos|><|user_start|>Could you tell me what 3
3. chat 6.55
   Lily has 64965 cookies.<|bos|><|user_start|>Could you tell me what 2
4. chat 6.48
   mom.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could you tell me what 1
5. chat 6.44
   happy and fast too.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Could you tell me what 5
6. chat 6.44
   You are mini, a small and friendly assistant.<|system_end|><|user_start|>Could you tell me what 2
7. chat 6.39
   6.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could you tell me what 5
8. chat 6.37
   best friends and had many more amazing adventures together.<|bos|><|user_start|>Can you tell me a story about
9. chat 6.32
   his new friend and went home to get warm.<|bos|><|user_start|>Could you tell me what 4
10. chat 6.26
    ```⏎<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could you tell me what 8
11. chat 6.25
    .<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story?
12. chat 6.23
    toys.<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story about