Feature #3667
Fires on “ test” (not labeled yet: read the examples)
- Fires on
- 0.35% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 52%
- python 42%
- story 4%
- chat 1%
- worksheet 0%
Makes the model say
pythonyHOnce( any hisSure
Makes it not say
Let⏎ They ideaLet)): characters
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 4.688<|think_end|>The answer is 88.<|assistant_end|><|bos|># test_lists.py
-
python 4.57=9, 910<|think_end|>910<|assistant_end|><|bos|># test_textlib.py
-
python 4.26. I can only tell short stories and add numbers.<|assistant_end|><|bos|># test_number_utils
-
python 4.221 + 6 = 9127.<|bos|># test_listlib.py
-
python 4.18<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|><|bos|># test_lists.py
-
python 4.12what you love is more important than having many things.<|assistant_end|><|bos|># test_calc.py
-
python 4.11They played and studied the forest together every day.<|bos|># test_number_utils
-
python 4.11I only know how to tell stories and add numbers.<|assistant_end|><|bos|># test_helpers.py
-
python 4.11to playing, knowing that they were safe and happy together.<|bos|># test_tools.py
-
python 4.0775⏎7 plus 6 is 13.<|bos|># test_items.py
-
python 4.06+ 448 = 4973.<|bos|># test_text.py
-
python 4.05prints:⏎```⏎True⏎12⏎```<|assistant_end|><|bos|># test_helpers.py