Feature #3635

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. story 2.52
   old lady was happy.<|bos|>Once upon a time, there was a
2. story 2.42
   <|assistant_start|>The answer is 86.<|assistant_end|><|bos|>Once upon a time, there was a
3. story 2.41
   quarrel anymore, and they were happy.<|bos|>Once upon a time, there was an
4. story 2.4
   , 105<|think_end|>105<|assistant_end|><|bos|>Once upon a time, there was a
5. story 2.39
   <|assistant_start|>The answer is 257.<|assistant_end|><|bos|>Once upon a time there was an old
6. story 2.37
   <|tool_end|><|assistant_start|>The answer is 74.<|assistant_end|><|bos|>Once upon a time, in a small
7. chat 2.36
   <|user_end|><|assistant_start|><|think_start|>07+95: 7+5=12, 2
8. story 2.36
   to show everyone back home!<|bos|>Once upon a time, in a small
9. story 2.36
   numbers. Try asking me for a story!<|assistant_end|><|bos|>Once upon a time, in a small
10. chat 2.35
    after.<|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time, there was a
11. story 2.35
    <|assistant_start|>The answer is 261.<|assistant_end|><|bos|>Once upon a time there was a little
12. story 2.34
    <|think_end|>The answer is 32.<|assistant_end|><|bos|>Once upon a time, there was a