Feature #1827
Fires on “<|tool_call_start|>” (not labeled yet: read the examples)
- Fires on
- 0.71% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 92%
- chat 6%
- story 2%
- worksheet 0%
- python 0%
Makes the model say
moralth been jo end As from being
Makes it not say
ies(case first()first Oneit
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 4.14: 'triangle'?⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=
-
agent 4.04AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>
-
agent 4.04AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>
-
agent 3.99'hello'?⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=
-
agent 3.98^^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>
-
agent 3.93^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>
-
agent 3.91⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=
-
agent 3.91"⏎ ^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>
-
agent 3.91biggest'?⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=
-
agent 3.91^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>
-
agent 3.89^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>
-
agent 3.89^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>