Skip to content
mini-lab
Features of prelude-2

Feature #1860

Fires on “Read” (not labeled yet: read the examples)

Fires on
0.39% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 44%
  • chat 28%
  • worksheet 23%
  • story 4%
  • python 1%

Makes the model say

do only isc it toyas other

Makes it not say

<|user_start|> list<|bos|> walked helped prints import"

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 1.72
    .<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=utils.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file utils.py
  2. story 1.66
    lined up at the starting line and the dog barked, "Ready, stead
  3. agent 1.66
    it<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=main.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file main.py
  4. agent 1.65
    .<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=utils.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file utils.py
  5. agent 1.65
    ."<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=strings.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file strings.py
  6. agent 1.65
    .<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=items.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file items.py
  7. agent 1.64
    ."<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=lib.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file lib.py
  8. agent 1.63
    .<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=hello.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file hello.py
  9. agent 1.63
    .<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=run.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file run.py
  10. agent 1.63
    .<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=main.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file main.py
  11. agent 1.63
    it<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=hello.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file hello.py
  12. agent 1.62
    .<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>path=helpers.py<|tool_call_end|><|assistant_end|><|tool_start|>Read file helpers.py