Feature #2140

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 2.13
   the talking crabs.<|bos|>Once upon a time, in a land far away, there was
2. chat 2.08
   the Python files in this project.<|assistant_end|><|bos|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! Would you
3. chat 2.07
   "I know, but I want to see it."⏎Bob swam far away to find the
4. story 2.04
   doll. She told the man she lived in a distant house, far away from the shop
5. chat 2.04
   sad again.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Hi<|user_end|><|assistant_start|>Hi there! Would you
6. story 2.02
   flower go?" Ant said, "I saw the wind take it far away."⏎B
7. chat 2.02
   ```<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Hi there! Would you
8. chat 2.01
   ild day.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! Would you
9. chat 2.0
   stories and add numbers.<|assistant_end|><|bos|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hi there! Would you
10. chat 2.0
    ⏎```⏎<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! Would you
11. chat 1.99
    ⏎30⏎1⏎```<|assistant_end|><|bos|><|user_start|>Hi<|user_end|><|assistant_start|>Hi there! Would you
12. chat 1.98
    ant.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Hi<|user_end|><|assistant_start|>Hi there! Would you