Feature #307

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 5.81
   <|user_end|><|assistant_start|>The answer is 21.<|assistant_end|><|user_start|>Could you tell me what 1 +
2. chat 5.74
   ⏎<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could you tell me what 89
3. chat 5.72
   4544 = 4550<|bos|><|user_start|>Tell me about yourself.<|user_end|>
4. chat 5.62
   was a sailor.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Tell me a story.<|user_end|>
5. chat 5.61
   (nums)`.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Tell me a story about a
6. chat 5.6
   <|assistant_end|><|bos|><|user_start|>Tell me a story about the
7. chat 5.6
   <|user_end|><|assistant_start|>The answer is 21.<|assistant_end|><|user_start|>Could you tell me what 1 +
8. chat 5.58
   their friends. And they all lived happily ever after.<|bos|><|user_start|>Tell me a story.<|user_end|>
9. chat 5.57
   new friend and went home to get warm.<|bos|><|user_start|>Could you tell me what 43
10. chat 5.52
    .<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could you tell me what 12
11. chat 5.52
    ⏎lemon⏎house!⏎```<|assistant_end|><|bos|><|user_start|>Could you tell me what 96
12. chat 5.49
    + 815 = 819.<|bos|><|user_start|>Tell me about the hist