Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #306

Fires on “<|arg|>” (not labeled yet: read the examples)

Fires on
0.48% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 96%
  • story 2%
  • chat 2%
  • worksheet 0%
  • python 0%

Makes the model say

oldString):demo OpenCodebled<|tool_call_end|>ptLook

Makes it not say

and we were back( are⏎⏎ let

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.59
    (TEXT))<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=script.py<|arg|>oldString=TX
  2. agent 2.52
    2]))<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=hello.py<|arg|>oldString=print(
  3. agent 2.5
    2))<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=main.py<|arg|>oldString=print(
  4. agent 2.47
    3]))<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=main.py<|arg|>oldString=print(
  5. agent 2.47
    (3))<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=app.py<|arg|>oldString=print(
  6. agent 2.46
    (TEXT))<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=main.py<|arg|>oldString=TEXT =
  7. agent 2.43
    (LIMIT))<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=main.py<|arg|>oldString=LIMIT =
  8. agent 2.43
    3]))<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=hello.py<|arg|>oldString=print(
  9. agent 2.42
    2]))<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=script.py<|arg|>oldString=print(
  10. agent 2.41
    da!<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path=demo.py<|arg|>content=print("
  11. agent 2.4
    (SIZE))<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=script.py<|arg|>oldString=SIZE =
  12. agent 2.37
    ("tree"))<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=hello.py<|arg|>oldString=print(