Feature #2537

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 2.1
   mom.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could you tell me what 1
2. chat 2.08
   ```⏎<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could you tell me what 8
3. chat 2.03
   0<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could you tell me what 2
4. chat 2.03
   numbers, step by step or with a calculator.<|assistant_end|><|user_start|>Can you tell me a story about
5. chat 2.02
   : calculator<|system_end|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Can you tell me a story about
6. chat 2.0
   The dragon was interesting because it had many colors.<|assistant_end|><|user_start|>Could you tell me what 9
7. chat 2.0
   2.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could you tell me what 6
8. chat 1.99
   from scratch on a laptop by mini-lab.<|assistant_end|><|user_start|>Can you tell me a story about
9. chat 1.99
   You are mini, a small and friendly assistant.<|system_end|><|user_start|>Could you tell me what 2
10. worksheet 1.98
    from scratch on a laptop by mini-lab.<|assistant_end|><|bos|>Could you tell me what 9
11. chat 1.98
    : calculator<|system_end|><|system_start|>Do not use the calculator.<|system_end|><|user_start|>Could you tell me what 0
12. chat 1.98
    Lily has 64965 cookies.<|bos|><|user_start|>Could you tell me what 2