Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1409

Fires on “<|assistant_start|>” (not labeled yet: read the examples)

Fires on
0.74% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 60%
  • chat 37%
  • story 2%
  • python 1%
  • worksheet 0%

Makes the model say

<|tool_call_start|><|think_start|>oldStringpattern<|assistant_end|> Line mini

Makes it not say

Once was were andBug lot are am

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 4.23
    coding agent harness.<|system_end|><|user_start|>What files are in this project?<|user_end|><|assistant_start|><|tool_call_start|>glob
  2. agent 4.22
    agent harness.<|system_end|><|user_start|>Which Python files are in this project?<|user_end|><|assistant_start|><|tool_call_start|>glob
  3. agent 4.18
    agent harness.<|system_end|><|user_start|>Which Python files are in this project?<|user_end|><|assistant_start|><|tool_call_start|>glob
  4. agent 4.14
    agent harness.<|system_end|><|user_start|>Which Python files are in this project?<|user_end|><|assistant_start|><|tool_call_start|>glob
  5. agent 4.04
    agent harness.<|system_end|><|user_start|>Which Python files are in this project?<|user_end|><|assistant_start|><|tool_call_start|>glob
  6. agent 3.99
    a coding agent harness.<|system_end|><|user_start|>What Python files are here?<|user_end|><|assistant_start|><|tool_call_start|>glob
  7. agent 3.97
    coding agent harness.<|system_end|><|user_start|>Find all .py files.<|user_end|><|assistant_start|><|tool_call_start|>glob
  8. agent 3.92
    coding agent harness.<|system_end|><|user_start|>Find all .py files.<|user_end|><|assistant_start|><|tool_call_start|>glob
  9. agent 3.91
    coding agent harness.<|system_end|><|user_start|>What files are in this project?<|user_end|><|assistant_start|><|tool_call_start|>glob
  10. agent 3.89
    coding agent harness.<|system_end|><|user_start|>Find all .py files.<|user_end|><|assistant_start|><|tool_call_start|>glob
  11. agent 3.86
    coding agent harness.<|system_end|><|user_start|>What files are in this project?<|user_end|><|assistant_start|><|tool_call_start|>glob
  12. agent 3.82
    coding agent harness.<|system_end|><|user_start|>Find all .py files.<|user_end|><|assistant_start|><|tool_call_start|>glob