Feature #670
Fires on “he” (not labeled yet: read the examples)
- Fires on
- 0.62% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 95%
- chat 2%
- story 1%
- worksheet 1%
- python 0%
Makes the model say
<|arg|>llpattern prelude typoechoate=**/
Makes it not say
., oneS Lily where then."
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 4.14test_mathlib.py pass?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
-
agent 4.08failing. Can you fix the code?"<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
-
agent 4.03<|user_start|>Does test_words.py pass?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
-
agent 4.0py is failing. Can you fix the code?"<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
-
agent 4.0.<|system_end|><|user_start|>What does app.py print?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
-
agent 3.99<|system_end|><|user_start|>"Can you run demo.py?"<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
-
agent 3.97Run the tests in test_utils.py."<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
-
agent 3.97.<|system_end|><|user_start|>Can you run main.py?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
-
agent 3.97Run the tests in test_utils.py.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
-
agent 3.97<|system_end|><|user_start|>"execute hello.py."<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
-
agent 3.96<|user_start|>make test_arith.py pass.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
-
agent 3.95py is failing. Can you fix the code?"<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=