Skip to content
mini-lab
Features of prelude-2

Feature #3452

Fires on “4” (not labeled yet: read the examples)

Fires on
0.36% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 89%
  • story 4%
  • chat 4%
  • python 2%
  • worksheet 1%

Makes the model say

,2M))6] pieces<|tool_call_end|>

Makes it not say

assertplOfUCreatedog ([

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.99
    <|tool_call_end|><|assistant_end|><|tool_start|>Read file hello.py, lines 1-14⏎1: def
  2. agent 3.8
    <|tool_call_end|><|assistant_end|><|tool_start|>Read file items.py, lines 1-13⏎1: def
  3. agent 3.79
    <|tool_call_end|><|assistant_end|><|tool_start|>Read file main.py, lines 1-13⏎1: def
  4. agent 3.78
    <|tool_call_end|><|assistant_end|><|tool_start|>Read file ops.py, lines 1-13⏎1: def
  5. agent 3.77
    <|tool_call_end|><|assistant_end|><|tool_start|>Read file greetings.py, lines 1-14⏎1: def
  6. agent 3.74
    <|tool_call_end|><|assistant_end|><|tool_start|>Read file run.py, lines 1-14⏎1: def
  7. agent 3.7
    <|tool_call_end|><|assistant_end|><|tool_start|>Read file demo.py, lines 1-10⏎1: def
  8. agent 3.68
    <|tool_call_end|><|assistant_end|><|tool_start|>Read file greetings.py, lines 1-10⏎1: def
  9. agent 3.68
    py<|tool_call_end|><|assistant_end|><|tool_start|>Read file items.py, lines 1-2⏎1: def
  10. agent 3.66
    <|tool_call_end|><|assistant_end|><|tool_start|>Read file arith.py, lines 1-14⏎1: def
  11. agent 3.66
    py<|tool_call_end|><|assistant_end|><|tool_start|>Read file strings.py, lines 1-2⏎1: def
  12. agent 3.64
    <|tool_call_end|><|assistant_end|><|tool_start|>Read file app.py, lines 1-15⏎1: def