Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3346

Fires on “<|tool_call_end|>” (not labeled yet: read the examples)

Fires on
0.61% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 88%
  • chat 10%
  • story 1%
  • python 1%
  • worksheet 0%

Makes the model say

<|tool_call_end|> He<|assistant_start|> NowreplaceAll It finishedlower

Makes it not say

b5 like fast and or youill

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 5.49
    by a space.<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=hello.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file
  2. agent 5.24
    a and b.<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=utils.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file
  3. agent 5.13
    a and b.<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=utils.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file
  4. agent 5.13
    s upper case.<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=greetings.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file
  5. agent 5.11
    greeting for name.<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=greetings.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file
  6. agent 5.11
    <|tool_call_start|>read<|arg|>path=words.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file
  7. agent 5.1
    letter of s.<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=lib.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file
  8. agent 5.08
    of nums doubled."<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=stats.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file
  9. agent 5.08
    whitespace and indentation.<|tool_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=items.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file
  10. agent 5.07
    the last item"<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=listlib.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file
  11. agent 5.06
    s reversed.<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=text.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file
  12. agent 5.06
    a and b."<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=helpers.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file