Skip to content
mini-lab
Features of prelude-2

Feature #1213

Fires on “<|tool_call_end|>” (not labeled yet: read the examples)

Fires on
3.44% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 57%
  • chat 34%
  • worksheet 5%
  • story 2%
  • python 1%

Makes the model say

<|assistant_end|><|tool_call_end|>[-<|assistant_start|><|bos|>replaceAll<|tool_start|>aeiou

Makes it not say

around in13A c4 tree

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.04
    0.<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=5 + 20<|tool_call_end|><|assistant_end|><|tool_start|>25
  2. chat 4.03
    0.<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=97 + 0<|tool_call_end|><|assistant_end|><|tool_start|>97
  3. agent 4.03
    letter of s.<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=lib.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file
  4. chat 3.95
    to it.<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=7 + 0<|tool_call_end|><|assistant_end|><|tool_start|>7<|tool_end|>
  5. agent 3.95
    the last item"<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=listlib.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file
  6. agent 3.95
    s upper case.<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=greetings.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file
  7. chat 3.94
    to it.<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=7 + 0<|tool_call_end|><|assistant_end|><|tool_start|>7<|tool_end|>
  8. chat 3.93
    ?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=77 + 10<|tool_call_end|><|assistant_end|><|tool_start|>87
  9. chat 3.92
    10, 10<|think_end|>The answer is 10.<|assistant_end|><|bos|>Sue has
  10. agent 3.91
    newString=count_items_v2<|arg|>replaceAll=true<|tool_call_end|><|assistant_end|><|tool_start|>Edited items
  11. agent 3.9
    plus<|arg|>newString=plus_v2<|arg|>replaceAll=true<|tool_call_end|><|assistant_end|><|tool_start|>Edited demo
  12. chat 3.9
    10, 10<|think_end|>The answer is 10.<|assistant_end|><|bos|><|user_start|>Can you