Skip to content
mini-lab
Features of prelude-2

Feature #670

Fires on “he” (not labeled yet: read the examples)

Fires on
0.62% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 95%
  • chat 2%
  • story 1%
  • worksheet 1%
  • python 0%

Makes the model say

<|arg|>llpattern prelude typoechoate=**/

Makes it not say

., oneS Lily where then."

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 4.14
    test_mathlib.py pass?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
  2. agent 4.08
    failing. Can you fix the code?"<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
  3. agent 4.03
    <|user_start|>Does test_words.py pass?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
  4. agent 4.0
    py is failing. Can you fix the code?"<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
  5. agent 4.0
    .<|system_end|><|user_start|>What does app.py print?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
  6. agent 3.99
    <|system_end|><|user_start|>"Can you run demo.py?"<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
  7. agent 3.97
    Run the tests in test_utils.py."<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
  8. agent 3.97
    .<|system_end|><|user_start|>Can you run main.py?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
  9. agent 3.97
    Run the tests in test_utils.py.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
  10. agent 3.97
    <|system_end|><|user_start|>"execute hello.py."<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
  11. agent 3.96
    <|user_start|>make test_arith.py pass.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=
  12. agent 3.95
    py is failing. Can you fix the code?"<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=