Feature #33
Fires on “<|tool_call_start|>” (not labeled yet: read the examples)
- Fires on
- 0.84% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 58%
- python 22%
- chat 15%
- story 4%
- worksheet 1%
Makes the model say
projectg⏎ acaseo passed another
Makes it not say
feel<|bos|> functionsWowth shared feelsY
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 2.79print(abs_value(3))⏎⏎⏎def min_of(a,
-
python 2.77⏎ return len(s)⏎```⏎⏎Bug: `min_item` should return
-
agent 2.76harness.<|system_end|><|user_start|>Where can I find count_items?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>
-
python 2.76test_lists.py⏎from lists import keep_even, min_item⏎⏎assert
-
chat 2.68<|system_end|><|user_start|>Hey, what's 4 plus 3?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=
-
chat 2.68Can you add 9 and 25 for me?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=
-
agent 2.68coding agent harness.<|system_end|><|user_start|>Where can I find contains?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>
-
chat 2.67<|system_start|>tools: calculator<|system_end|><|user_start|>1 + 5 = ?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=
-
agent 2.67coding agent harness.<|system_end|><|user_start|>Find where first is defined.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>
-
agent 2.66(half(LIMIT))⏎⏎⏎def min_of(a,
-
python 2.658, 8, 7])⏎3⏎<|bos|>`min_item(nums)`
-
chat 2.63<|system_end|><|user_start|>I need to know 6 + 1.<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=