Feature #1350
Fires on “l” (not labeled yet: read the examples)
- Fires on
- 0.57% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 67%
- chat 26%
- story 6%
- python 1%
- worksheet 0%
Makes the model say
<|arg|>FixedoldString<|assistant_end|> trainedCreateontAdd
Makes it not say
theyin saids They we be A
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 2.9.<|system_end|><|user_start|>"Are the tests passing?"<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
-
agent 2.77harness.<|system_end|><|user_start|>Are the tests passing?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
-
agent 2.66harness.<|system_end|><|user_start|>Check the tests.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
-
agent 2.66<|system_end|><|user_start|>run the tests and fix any bug.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
-
agent 2.65<|system_end|><|user_start|>The tests are failing, fix the bug<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
-
agent 2.65agent harness.<|system_end|><|user_start|>Check the tests<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
-
agent 2.64<|user_start|>The tests fail. Can you fix them?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
-
agent 2.64.<|system_end|><|user_start|>What files are in this project?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
-
agent 2.63harness.<|system_end|><|user_start|>Can you run the tests?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
-
agent 2.63<|system_end|><|user_start|>Which Python files are in this project?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/*.
-
agent 2.62tests pass.<|assistant_end|><|user_start|>Do the tests pass?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
-
agent 2.61<|system_end|><|user_start|>Run the tests and fix any bug.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/