Skip to content
mini-lab
Features of prelude-2

Feature #391

Fires on “command” (not labeled yet: read the examples)

Fires on
0.32% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 95%
  • story 3%
  • chat 1%
  • worksheet 0%
  • python 0%

Makes the model say

command "!"`.uealseortletter calculatorhello

Makes it not say

sum that. the when small next len

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.76
    <|tool_call_start|>shell<|arg|>command=python3
  2. agent 2.76
    <|tool_call_start|>shell<|arg|>command=python3
  3. agent 2.76
    <|tool_call_start|>shell<|arg|>command=python3
  4. agent 2.74
    . Can you fix the code?"<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test
  5. agent 2.69
    main.py.<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 main
  6. agent 2.64
    What does hello.py print?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 hello
  7. agent 2.61
    execute main.py."<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 main
  8. agent 2.57
    py⏎test_stats.py<|tool_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test
  9. agent 2.57
    . Can you fix the code?"<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test
  10. agent 2.53
    . Can you fix the code?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test
  11. agent 2.53
    Fix it."<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 main
  12. agent 2.53
    py⏎test_core.py<|tool_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test