Skip to content
mini-lab
Features of prelude-2

Feature #468

Fires on “<|tool_call_start|>” (not labeled yet: read the examples)

Fires on
0.44% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 56%
  • story 26%
  • python 8%
  • chat 6%
  • worksheet 5%

Makes the model say

ice They friendsWetreedyname anyone

Makes it not say

<|system_end|> code`<|tool_call_end|><|tool_call_start|>],fact upon

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.43
    <|tool_call_start|>read<|arg|>path=
  2. agent 2.43
    <|tool_call_start|>grep<|arg|>
  3. agent 2.43
    <|tool_call_start|>glob<|arg|>
  4. agent 2.43
    <|tool_call_start|>write<|arg|>path
  5. chat 2.43
    <|tool_call_start|>calculator<|arg|>expression=
  6. agent 2.43
    <|tool_call_start|>shell<|arg|>
  7. agent 2.43
    <|tool_call_start|>read<|arg|>path=
  8. agent 2.43
    <|tool_call_start|>read<|arg|>path=
  9. agent 2.43
    <|tool_call_start|>shell<|arg|>
  10. agent 2.43
    <|tool_call_start|>edit<|arg|>path
  11. agent 2.43
    <|tool_call_start|>shell<|arg|>
  12. agent 2.43
    <|tool_call_start|>edit<|arg|>path