Feature #3500
Fires on “Fix” (not labeled yet: read the examples)
- Fires on
- 0.40% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 76%
- python 20%
- story 2%
- chat 2%
- worksheet 1%
Makes the model say
Fix typogrepeatNo'tagPlease
Makes it not say
<|assistant_end|>."!" g named sunny'spattern
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 2.87loud(s):⏎ return s.lower()⏎```⏎⏎Fix: replace `return
-
agent 2.7the bug caught by test_math_utils.py.<|user_end|><|assistant_start|>Fix failing test_math
-
python 2.67case(s):⏎ return s.upper()⏎```⏎⏎Fix: replace `return
-
python 2.67case(s):⏎ return s.lower()⏎```⏎⏎Fix: replace `return
-
python 2.67(a, b):⏎ return a + a⏎```⏎⏎Fix: replace `return
-
agent 2.66hello.py that prints Welcome!<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path=hello.py
-
python 2.65):⏎ return x % 3 == 0⏎```⏎⏎Fix: replace `return
-
python 2.63quiet(s):⏎ return s.upper()⏎```⏎⏎Fix: replace `return
-
python 2.62b):⏎ return a % b == 1⏎```⏎⏎Fix: replace `return
-
python 2.61quiet(s):⏎ return s.upper()⏎```⏎⏎Fix: replace `return
-
python 2.61⏎ return (a + b) / 3⏎```⏎⏎Fix: replace `return
-
python 2.6b):⏎ return a + b / 2⏎```⏎⏎Fix: replace `return