Feature #1859
Fires on “from” (not labeled yet: read the examples)
- Fires on
- 0.16% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 50%
- story 38%
- chat 7%
- agent 5%
- worksheet 0%
Makes the model say
was is this new little own had were
Makes it not say
<|tool_call_start|>Fix<|arg|>Set trained<|think_start|><|user_start|>expression
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 5.097, 6))⏎⏎# test_ops.py⏎from ops import add,
-
python 5.02project.⏎⏎# test_stats.py⏎from stats import has_
-
python 5.00<|think_end|>910<|assistant_end|><|bos|># test_textlib.py⏎from textlib import echo,
-
python 4.98⏎12⏎```<|assistant_end|><|bos|># test_helpers.py⏎from helpers import first,
-
python 4.94.py`.<|assistant_end|><|bos|># test_words.py⏎from words import exclaim,
-
python 4.92.json"⏎}⏎⏎# test_tools.py⏎from tools import flip,
-
python 4.9" + name + "!"⏎⏎# test_text.py⏎from text import whisper,
-
python 4.9requirements.txt⏎pytest⏎⏎# test_tools.py⏎from tools import factorial,
-
python 4.892⏎⏎# test_helpers.py⏎from helpers import smaller,
-
python 4.88(loud("house"))⏎⏎# test_text.py⏎from text import loud,
-
python 4.87were safe and happy together.<|bos|># test_tools.py⏎from tools import square,
-
python 4.86```⏎hello⏎```<|assistant_end|><|bos|># test_tools.py⏎from tools import whisper⏎