Feature #1123

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 3.65
   <|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story
2. chat 3.63
   every day.<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story
3. chat 3.57
   a helpful assistant.<|system_end|><|user_start|>Can you add 53
4. chat 3.53
   project.<|assistant_end|><|bos|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Can you tell me a story
5. worksheet 3.52
   1 + 86 = 147.<|bos|>Can you add 48
6. chat 3.5
   the toys.<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story
7. chat 3.45
   now.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story
8. chat 3.43
   tools: calculator<|system_end|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Can you tell me a story
9. chat 3.41
   didn't like to play with the other boats.<|assistant_end|><|user_start|>Can you tell me a story
10. python 3.35
    LIMIT = 4⏎print(abs_value(LIMIT))⏎print(first_letter
11. chat 3.35
    6 shells.<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story
12. chat 3.31
    83<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Can you add 51