Feature #18

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 5.45
   to do what you want them to do.<|bos|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>
2. chat 5.24
   was gone. The big bookcase stayed sad.<|bos|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>
3. story 5.06
   upon a time, there was a girl named Lily. Lily was a bossy girl. She liked
4. chat 5.02
   purpose.<|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>
5. chat 4.97
   fix the Python files in this project.<|assistant_end|><|bos|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>
6. chat 4.96
   the race together.<|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>
7. chat 4.89
   .<|assistant_end|><|bos|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>
8. story 4.86
   a boy named Jack. Jack was three years old and he was an honest boy. He liked
9. story 4.8
   SE"`.⏎<|bos|>Once upon a time, there was a big, bossy rabbit named Bob.
10. chat 4.78
    add numbers.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>
11. chat 4.76
    to add?<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>
12. chat 4.72
    to own a big yard to play in.<|bos|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>