Skip to content
mini-lab
Features of prelude-2

Feature #1442

Fires on “2” (not labeled yet: read the examples)

Fires on
4.69% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 69%
  • worksheet 16%
  • chat 7%
  • story 4%
  • python 3%

Makes the model say

an1Mom0(" ( course's

Makes it not say

` foodOnce?"<|think_start|> ifThank Max

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.11
    command=python3 script.py<|tool_call_end|><|assistant_end|><|tool_start|>True⏎9⏎28⏎<|tool_end|><|assistant_start|>
  2. agent 3.06
    python3 script.py<|tool_call_end|><|assistant_end|><|tool_start|>22⏎False⏎64⏎<|tool_end|><|assistant_start|>`
  3. agent 3.01
    3 main.py<|tool_call_end|><|assistant_end|><|tool_start|>False⏎108⏎120⏎<|tool_end|><|assistant_start|>
  4. agent 3.0
    command=python3 hello.py<|tool_call_end|><|assistant_end|><|tool_start|>False⏎4⏎10⏎<|tool_end|><|assistant_start|>
  5. agent 2.96
    command=python3 run.py<|tool_call_end|><|assistant_end|><|tool_start|>7⏎9⏎27⏎<|tool_end|><|assistant_start|>
  6. agent 2.9
    =python3 hello.py<|tool_call_end|><|assistant_end|><|tool_start|>0⏎40⏎1⏎<|tool_end|><|assistant_start|>`
  7. agent 2.89
    =python3 app.py<|tool_call_end|><|assistant_end|><|tool_start|>6⏎a⏎-6⏎<|tool_end|><|assistant_start|>`
  8. agent 2.89
    =python3 main.py<|tool_call_end|><|assistant_end|><|tool_start|>2⏎tree cloud⏎7⏎<|tool_end|><|assistant_start|>`
  9. agent 2.88
    python3 main.py<|tool_call_end|><|assistant_end|><|tool_start|>7⏎duolc⏎12⏎<|tool_end|><|assistant_start|>`
  10. agent 2.87
    python3 main.py<|tool_call_end|><|assistant_end|><|tool_start|>revir⏎5⏎8⏎<|tool_end|><|assistant_start|>`
  11. agent 2.85
    apple apple⏎[0, 0, 2]⏎12⏎<|tool_end|><|assistant_start|>`
  12. agent 2.83
    =python3 run.py<|tool_call_end|><|assistant_end|><|tool_start|>2⏎15⏎1⏎<|tool_end|><|assistant_start|>`