Feature #3388
Fires on “from” (not labeled yet: read the examples)
- Fires on
- 0.44% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 65%
- agent 19%
- chat 11%
- story 5%
- worksheet 0%
Makes the model say
home way listlibly morning bed dress ground
Makes it not say
"<|tool_call_end|>md<|arg|>=**/ import`.lower
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 4.85.py`.<|assistant_end|><|bos|># test_words.py⏎from words import exclaim,
-
python 4.753)⏎-3⏎<|bos|># test_calc.py⏎from calc import min_
-
python 4.65```⏎hello⏎```<|assistant_end|><|bos|># test_tools.py⏎from tools import whisper⏎
-
python 4.640<|think_end|>910<|assistant_end|><|bos|># test_textlib.py⏎from textlib import echo,
-
python 4.63⏎12⏎```<|assistant_end|><|bos|># test_helpers.py⏎from helpers import first,
-
python 4.6for another story soon.<|assistant_end|><|bos|># test_words.py⏎from words import final_
-
python 4.532⏎⏎# test_helpers.py⏎from helpers import smaller,
-
python 4.53ave a nice day.<|assistant_end|><|bos|># test_lists.py⏎from lists import has_
-
python 4.4add numbers.<|assistant_end|><|bos|># test_number_utils.py⏎from number_utils import
-
python 4.38is 88.<|assistant_end|><|bos|># test_lists.py⏎from lists import keep_
-
python 4.35project.⏎⏎# test_stats.py⏎from stats import has_
-
python 4.34requirements.txt⏎pytest⏎⏎# test_tools.py⏎from tools import factorial,