Feature #1341
Fires on “ test” (not labeled yet: read the examples)
- Fires on
- 0.45% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 44%
- python 34%
- story 19%
- chat 2%
- worksheet 1%
Makes the model say
_( test<|assistant_end|> next laptop filespattern
Makes it not say
ouFalsewarlprintexclaimth
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 4.71+ b⏎⏎$ python3 test_core.py
-
python 4.69⏎$ python3 test_items.py
-
python 4.52⏎10⏎$ python3 test_number_utils
-
python 4.484, 0]⏎5⏎$ python3 test_listlib.py
-
python 4.43$ python3 test_lib.py
-
python 4.41=9, 910<|think_end|>910<|assistant_end|><|bos|># test_textlib.py
-
python 4.423⏎print("all tests passed")⏎⏎$ python3 test_calc.py
-
python 4.35⏎all tests passed⏎$ python3 test_items.py
-
python 4.33. I can only tell short stories and add numbers.<|assistant_end|><|bos|># test_number_utils
-
python 4.388<|think_end|>The answer is 88.<|assistant_end|><|bos|># test_lists.py
-
python 4.29They played and studied the forest together every day.<|bos|># test_number_utils
-
python 4.284.⏎0 + 16 = 16<|bos|># test_helpers.py