Feature #3656
Fires on “#” (not labeled yet: read the examples)
- Fires on
- 0.39% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 65%
- worksheet 24%
- chat 4%
- story 4%
- agent 2%
Makes the model say
READMESam<|arg|> space %doubled +[::-
Makes it not say
best didp most⏎ times But story
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 5.22was gone forever, and the town was never the same again.<|bos|># number_utils.
-
python 5.186<|tool_end|><|assistant_start|>The answer is 1656.<|assistant_end|><|bos|># listlib.py⏎
-
python 5.14Have a nice day.<|assistant_end|><|bos|># textlib.py⏎
-
python 5.09passes: all tests passed.<|assistant_end|><|bos|># lib.py⏎
-
python 5.08, 88<|think_end|>The answer is 88.<|assistant_end|><|bos|># test_lists.
-
python 5.06today?<|assistant_end|><|bos|># opencode.json⏎
-
python 5.05home sad.<|bos|># utils.py⏎
-
python 5.05popular.<|assistant_end|><|bos|># notes.txt⏎
-
python 5.04in this project.<|assistant_end|><|bos|># LICENSE⏎MIT License
-
python 5.0513<|think_end|>513<|assistant_end|><|bos|># tools.py⏎
-
python 4.997<|think_end|>Sure! The answer is 167.<|assistant_end|><|bos|># requirements.txt⏎
-
python 4.991=9, 910<|think_end|>910<|assistant_end|><|bos|># test_textlib.