Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #4002

Fires on “py” (not labeled yet: read the examples)

Fires on
0.55% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 86%
  • python 10%
  • story 4%
  • worksheet 0%
  • chat 0%

Makes the model say

long finally a also would pretty just never

Makes it not say

were)`.deffrom typoNonewout

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.1
    <|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test_greetings.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback
  2. agent 3.09
    <|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test_lib.py<|tool_call_end|><|assistant_end|><|tool_start|>all
  3. agent 3.07
    <|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test_stats.py<|tool_call_end|><|assistant_end|><|tool_start|>all
  4. agent 3.06
    <|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test_utils.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback
  5. agent 3.04
    <|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test_mathlib.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback
  6. agent 3.02
    <|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test_arith.py<|tool_call_end|><|assistant_end|><|tool_start|>all
  7. agent 3.01
    <|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test_arith.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback
  8. agent 2.98
    <|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test_utils.py<|tool_call_end|><|assistant_end|><|tool_start|>all
  9. agent 2.98
    <|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test_listlib.py<|tool_call_end|><|assistant_end|><|tool_start|>all
  10. agent 2.96
    <|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test_stats.py<|tool_call_end|><|assistant_end|><|tool_start|>all
  11. agent 2.96
    <|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test_greetings.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback
  12. agent 2.96
    <|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test_greetings.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback