Skip to content
mini-lab
Features of prelude-2

Feature #434

Fires on “ll” (not labeled yet: read the examples)

Fires on
0.87% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 86%
  • story 8%
  • chat 4%
  • python 2%
  • worksheet 0%

Makes the model say

enteneant<|arg|>tat p

Makes it not say

`:`"), manyRenameIf files

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 5.1
    <|system_end|><|user_start|>What does app.py print?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python
  2. agent 5.08
    harness.<|system_end|><|user_start|>run the project<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python
  3. agent 4.98
    <|system_end|><|user_start|>run the program.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python
  4. agent 4.96
    <|user_start|>Execute app.py.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python
  5. agent 4.88
    <|system_end|><|user_start|>Run the program.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python
  6. agent 4.87
    .py fails, please fix it.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python
  7. agent 4.86
    Please execute run.py.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python
  8. agent 4.86
    What's the output of run.py?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python
  9. agent 4.83
    is failing. Can you fix the code?"<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python
  10. agent 4.79
    What's the output of script.py?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python
  11. agent 4.79
    <|system_end|><|user_start|>run main.py for me.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python
  12. agent 4.78
    <|assistant_end|><|user_start|>What does main.py print?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python