Skip to content
mini-lab
Features of prelude-2

Feature #1042

Fires on “<|arg|>” (not labeled yet: read the examples)

Fires on
0.29% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 69%
  • story 17%
  • python 10%
  • chat 4%
  • worksheet 0%

Makes the model say

=**/`:pattern Try<|assistant_start|> donenewStringye

Makes it not say

``` small big_ fast more town part

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.73
    <|assistant_end|><|user_start|>What Python files are here?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/*.py<|tool_call_end|>
  2. agent 2.68
    <|assistant_end|><|user_start|>Check the tests.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.
  3. agent 2.67
    .<|system_end|><|user_start|>List all files.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/*<|tool_call_end|>
  4. agent 2.65
    .<|assistant_end|><|user_start|>Do the tests pass?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.
  5. agent 2.64
    Which Python files are in this project?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/*.py<|tool_call_end|>
  6. agent 2.64
    <|system_end|><|user_start|>What Python files are here?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/*.py<|tool_call_end|>
  7. agent 2.63
    <|user_start|>What Python files are here?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/*.py<|tool_call_end|>
  8. agent 2.63
    The tests are failing, fix the bug<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.
  9. agent 2.62
    run the tests and fix any bug."<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.
  10. agent 2.58
    <|user_start|>"Are the tests passing?"<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.
  11. agent 2.58
    "Show me the Python files."<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/*.py<|tool_call_end|>
  12. agent 2.57
    <|system_end|><|user_start|>"List the files."<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/*<|tool_call_end|>