Feature #2726
Fires on “core” (not labeled yet: read the examples)
- Fires on
- 1.02% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 59%
- python 20%
- worksheet 12%
- chat 6%
- story 2%
Makes the model say
.) join laptop friends]⏎⏎ enjoyed
Makes it not say
3 she7 day61 She Tom
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 5.26test_text.py<|tool_call_end|><|assistant_end|>
-
python 4.98⏎```⏎True⏎12⏎```<|assistant_end|><|bos|># test_helpers.py⏎from
-
python 4.95test_listlib.py⏎from
-
agent 4.95test_listlib.py<|tool_call_end|><|assistant_end|>
-
python 4.95$ python3 main.py⏎4⏎$ python3 test_tools.py⏎all
-
python 4.95_listlib.py⏎all tests passed⏎$ python3 test_core.py⏎all
-
python 4.94now prints:⏎```⏎hello⏎```<|assistant_end|><|bos|># test_tools.py⏎from
-
python 4.93⏎0 + 16 = 16<|bos|># test_helpers.py⏎from
-
python 4.92.md` and `textlib.py`.<|assistant_end|><|bos|># test_core.py⏎from
-
python 4.918<|think_end|>The answer is 88.<|assistant_end|><|bos|># test_lists.py⏎from
-
python 4.91⏎print("all tests passed")⏎⏎$ python3 test_utils.py⏎all
-
python 4.91+ b⏎⏎$ python3 test_core.py⏎all