Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1174

Fires on “<|tool_call_start|>” (not labeled yet: read the examples)

Fires on
3.18% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 54%
  • agent 40%
  • story 5%
  • python 1%
  • worksheet 0%

Makes the model say

calculatorgdef tests shortThankonfig high

Makes it not say

". b of so heres g Anna

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 8.75
    files<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>
  2. chat 8.68
    <|think_start|>079+
  3. chat 8.68
    <|think_start|>006+
  4. chat 8.68
    <|think_start|>03+2
  5. chat 8.68
    <|think_start|>48+9
  6. agent 7.04
    <|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>
  7. agent 7.04
    <|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>
  8. agent 7.04
    <|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>
  9. agent 7.04
    <|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
  10. agent 7.04
    <|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
  11. agent 7.04
    <|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>
  12. agent 6.82
    ?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>