Feature #3968
Fires on “<|assistant_end|>” (not labeled yet: read the examples)
- Fires on
- 2.80% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 78%
- chat 17%
- story 4%
- python 0%
- worksheet 0%
Makes the model say
[-<|bos|>Are tests are<|user_start|><|assistant_end|>newString
Makes it not say
ing andb anassert seen bluenums
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 4.34?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|><|tool_start|>test_items
-
agent 4.25."<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|><|tool_start|>test_words
-
agent 4.25?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|><|tool_start|>test_arith
-
agent 4.24math_utils.py<|tool_call_end|><|assistant_end|><|tool_start|>all tests passed
-
agent 4.23.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|><|tool_start|>test_utils
-
agent 4.2.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|><|tool_start|>test_words
-
agent 4.19.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|><|tool_start|>test_lists
-
agent 4.17.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|><|tool_start|>test_core
-
agent 4.16?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|><|tool_start|>test_items
-
agent 4.15=app.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file app
-
agent 4.14.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|><|tool_start|>test_utils
-
agent 4.13?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|><|tool_start|>test_tools