Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3186

Fires on “py” (not labeled yet: read the examples)

Fires on
0.76% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 91%
  • chat 6%
  • story 2%
  • python 1%
  • worksheet 1%

Makes the model say

<|tool_call_end|> editpyckedenaeiou exclamationave

Makes it not say

, and something her the a.!

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.47
    .<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 hello.py<|tool_call_end|><|assistant_end|><|tool_start|>[
  2. agent 2.47
    .<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 hello.py<|tool_call_end|><|assistant_end|><|tool_start|>False
  3. agent 2.45
    ?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 main.py<|tool_call_end|><|assistant_end|><|tool_start|>1
  4. agent 2.44
    ?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 main.py<|tool_call_end|><|assistant_end|><|tool_start|>6
  5. agent 2.44
    ."<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 hello.py<|tool_call_end|><|assistant_end|><|tool_start|>6
  6. agent 2.43
    ?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 app.py<|tool_call_end|><|assistant_end|><|tool_start|>4
  7. agent 2.42
    ."<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 hello.py<|tool_call_end|><|assistant_end|><|tool_start|>1
  8. agent 2.41
    ?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 main.py<|tool_call_end|><|assistant_end|><|tool_start|>re
  9. agent 2.4
    py<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 hello.py<|tool_call_end|><|assistant_end|><|tool_start|>4
  10. agent 2.39
    .<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 demo.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback
  11. agent 2.39
    ?<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 hello.py<|tool_call_end|><|assistant_end|><|tool_start|>Hello
  12. agent 2.38
    .<|user_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 demo.py<|tool_call_end|><|assistant_end|><|tool_start|>1