Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2588

Fires on “test” (not labeled yet: read the examples)

Fires on
0.46% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 99%
  • story 1%
  • python 0%
  • chat 0%
  • worksheet 0%

Makes the model say

,"ed over Please next",_*.Bob

Makes it not say

caI":vingcyause Now

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.45
    <|user_start|>Run the tests.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|>
  2. agent 3.43
    <|user_start|>Run the tests.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|>
  3. agent 3.41
    <|user_start|>Run the tests.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|>
  4. agent 3.39
    Check the tests<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|>
  5. agent 3.38
    Do the tests pass?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|>
  6. agent 3.36
    heck the tests.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|>
  7. agent 3.36
    <|user_start|>run the tests.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|>
  8. agent 3.36
    <|user_start|>Run the tests.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|>
  9. agent 3.35
    , fix the bug.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|>
  10. agent 3.31
    the test suite.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|>
  11. agent 3.31
    , fix the bug."<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|>
  12. agent 3.31
    Do the tests pass?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/test_*.py<|tool_call_end|><|assistant_end|>