Feature #2768

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 2.65
   9<|think_end|>The answer is 189.<|assistant_end|><|bos|><|user_start|>I need to know 8
2. chat 2.52
   be very yummy, and they had a fun day.<|bos|><|user_start|>I need to know 4
3. chat 2.47
   94<|think_end|>The answer is 94.<|assistant_end|><|bos|><|user_start|>I need to know 5
4. chat 2.4
   887 = 1507.<|bos|><|user_start|>I need to know 8
5. chat 2.35
   2 and 79 is 151.<|bos|><|user_start|>I need to know 2
6. chat 2.29
   308 = 13142.<|bos|><|user_start|>I need to know 5
7. chat 2.27
   his football all day long.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>I need to know 8
8. chat 2.25
   78<|think_end|>The answer is 78.<|assistant_end|><|bos|><|user_start|>I need to know 3
9. chat 2.23
   175.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>I need to know 8
10. chat 2.23
    179 equals 54218.<|bos|><|user_start|>I need to know 7
11. chat 2.21
    69<|think_end|>The answer is 69.<|assistant_end|><|bos|><|user_start|>I need to know 5
12. story 2.18
    <|bos|>One day, a little ball named B