Feature #3162
Fires on “_” (not labeled yet: read the examples)
- Fires on
- 0.72% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 56%
- worksheet 17%
- python 13%
- chat 12%
- story 2%
Makes the model say
utils19etoo itsrun(
Makes it not say
<|assistant_end|><|bos|> let only$",Goodood
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.32in the park with their gray dog, Max. They like to play hide and seek with Max
-
python 3.3only tell short stories and add numbers.<|assistant_end|><|bos|># test_number_utils.py⏎
-
story 3.2<|assistant_end|><|bos|>Lily and Ben are brother and sister. They like to play hide and seek on Su
-
story 3.19the park and in the house. One day, they decided to play hide and seek. Lily
-
agent 3.15title generator.<|system_end|><|user_start|>fix the bug caught by test_math_utils.py.
-
agent 3.14a coding agent harness.<|system_end|><|user_start|>Run the tests in test_math_utils.py.
-
python 3.07[-1]`. The tests pass now.<|assistant_end|><|bos|># test_math_utils.py⏎
-
python 2.97studied the forest together every day.<|bos|># test_number_utils.py⏎
-
agent 2.93in OpenCode, a coding agent harness.<|system_end|><|user_start|>Make test_math_utils.py pass
-
story 2.85time, there was a little girl named Lily. She liked to play hide and seek with her
-
story 2.83time, there was a little girl named Lily. She loved to play hide and seek with her
-
agent 2.82rite<|arg|>path=number_utils.py<|arg|>