Skip to content
mini-lab
Features of prelude-2

Feature #1350

Fires on “l” (not labeled yet: read the examples)

Fires on
0.57% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 67%
  • chat 26%
  • story 6%
  • python 1%
  • worksheet 0%

Makes the model say

<|arg|>FixedoldString<|assistant_end|> trainedCreateontAdd

Makes it not say

theyin saids They we be A

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.9
    .<|system_end|><|user_start|>"Are the tests passing?"<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
  2. agent 2.77
    harness.<|system_end|><|user_start|>Are the tests passing?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
  3. agent 2.66
    harness.<|system_end|><|user_start|>Check the tests.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
  4. agent 2.66
    <|system_end|><|user_start|>run the tests and fix any bug.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
  5. agent 2.65
    <|system_end|><|user_start|>The tests are failing, fix the bug<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
  6. agent 2.65
    agent harness.<|system_end|><|user_start|>Check the tests<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
  7. agent 2.64
    <|user_start|>The tests fail. Can you fix them?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
  8. agent 2.64
    .<|system_end|><|user_start|>What files are in this project?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
  9. agent 2.63
    harness.<|system_end|><|user_start|>Can you run the tests?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
  10. agent 2.63
    <|system_end|><|user_start|>Which Python files are in this project?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/*.
  11. agent 2.62
    tests pass.<|assistant_end|><|user_start|>Do the tests pass?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/
  12. agent 2.61
    <|system_end|><|user_start|>Run the tests and fix any bug.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/