Skip to content
mini-lab
Features of prelude-2

Feature #3504

Fires on “ call” (not labeled yet: read the examples)

Fires on
0.22% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 69%
  • chat 18%
  • story 11%
  • python 1%
  • worksheet 0%

Makes the model say

model trainedt himself out e him

Makes it not say

`.7 townchars We item yard All

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.22
    python3 test_calc.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File
  2. agent 3.22
    python3 test_calc.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File
  3. agent 3.15
    command=python3 app.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File
  4. agent 3.13
    command=python3 app.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File
  5. agent 3.1
    python3 test_strings.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File
  6. agent 3.06
    command=python3 run.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File
  7. agent 2.99
    python3 test_mathlib.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File
  8. agent 2.99
    command=python3 script.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File
  9. agent 2.99
    test_math_utils.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File
  10. agent 2.97
    command=python3 hello.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File
  11. agent 2.95
    test_math_utils.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File
  12. agent 2.93
    python3 test_greetings.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File