Skip to content
mini-lab
Features of prelude-2

Feature #3170

Fires on “py” (not labeled yet: read the examples)

Fires on
0.66% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 88%
  • chat 5%
  • python 4%
  • story 3%
  • worksheet 1%

Makes the model say

alseanghello multiplylab"`. now `"

Makes it not say

should TheyLetexclaim`⏎They Then

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 1.86
    `sum_list([1, 0, 2])` returns `3`.⏎<|bos|>
  2. python 1.63
    2, 4, 1, 0, 4])⏎11⏎<|bos|>
  3. agent 1.61
    call last):⏎ File "app.py", line 4
  4. agent 1.59
    Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=main.py<|tool_call_end|><|assistant_end|><|tool_start|>Read
  5. python 1.58
    list([1, 2, 0, 7]) == 10⏎print
  6. agent 1.56
    Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=main.py<|tool_call_end|><|assistant_end|><|tool_start|>Read
  7. agent 1.56
    Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=app.py<|tool_call_end|><|assistant_end|><|tool_start|>Read
  8. agent 1.55
    Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=script.py<|tool_call_end|><|assistant_end|><|tool_start|>Read
  9. agent 1.54
    Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=main.py<|tool_call_end|><|assistant_end|><|tool_start|>Read
  10. agent 1.53
    Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=main.py<|tool_call_end|><|assistant_end|><|tool_start|>Read
  11. agent 1.53
    Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=demo.py<|tool_call_end|><|assistant_end|><|tool_start|>Read
  12. agent 1.52
    = "code"⏎<|tool_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=run.py<|tool_call_end|><|assistant_end|><|tool_start|>Read