Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1230

Fires on “<|tool_call_start|>” (not labeled yet: read the examples)

Fires on
0.32% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 78%
  • chat 12%
  • story 9%
  • python 0%
  • worksheet 0%

Makes the model say

is was a noise such herDone

Makes it not say

filesAddedincludesopleed rever wishpe

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 1.5
    <|assistant_start|><|tool_call_start|>shell<|arg|>
  2. agent 1.5
    <|assistant_start|><|tool_call_start|>write<|arg|>path
  3. agent 1.5
    <|assistant_start|><|tool_call_start|>read<|arg|>path=
  4. agent 1.5
    <|assistant_start|><|tool_call_start|>edit<|arg|>path
  5. agent 1.5
    <|assistant_start|><|tool_call_start|>edit<|arg|>path
  6. chat 1.5
    <|assistant_start|><|tool_call_start|>calculator<|arg|>expression=
  7. agent 1.5
    <|assistant_start|><|tool_call_start|>read<|arg|>path=
  8. agent 1.5
    <|assistant_start|><|tool_call_start|>shell<|arg|>
  9. agent 1.5
    <|assistant_start|><|tool_call_start|>read<|arg|>path=
  10. agent 1.5
    <|assistant_start|><|tool_call_start|>edit<|arg|>path
  11. agent 1.5
    <|assistant_start|><|tool_call_start|>read<|arg|>path=
  12. agent 1.5
    <|assistant_start|><|tool_call_start|>read<|arg|>path=