Feature #3714

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

1. chat 3.68
   a short story about a bird.<|user_end|><|assistant_start|>One day, a bossy bird named Bob was flying
2. chat 3.27
   a story!<|user_end|><|assistant_start|>Once upon a time, there was a cute bunny named Bob.
3. chat 3.27
   .<|user_end|><|assistant_start|>Once upon a time, there was a cheerful little bunny named Bobby.
4. story 3.23
   proud of him.<|bos|>Once upon a time, there was a grumpy bird. The bird lived
5. story 3.22
   Created `run.py`.<|assistant_end|><|bos|>One day, a playful bunny named Bob went to
6. chat 3.21
   <|system_end|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>One day, a grumpy cat named Mark had a
7. story 3.19
   1382<|bos|>Once upon a time, there was an ugly frog. He lived in
8. story 3.19
   all tests passed⏎<|bos|>Once upon a time, there was a brave bird named Bob. Bob
9. story 3.15
   1.<|assistant_end|><|bos|>Once upon a time, there was a clever cat named Tom. Tom
10. story 3.15
    5.<|assistant_end|><|bos|>Once upon a time, there was a little bunny. The bunny wanted
11. story 3.15
    ` with `factorial(n)`.<|assistant_end|><|bos|>One day, a clever cat named Tom found a
12. story 3.14
    )` returns x squared.<|assistant_end|><|bos|>One day, a grumpy cat named Tom went to