Skip to content
mini-lab
Features of prelude-2

Feature #1546

Fires on “ "” (not labeled yet: read the examples)

Fires on
0.76% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 96%
  • story 2%
  • chat 1%
  • python 1%
  • worksheet 0%

Makes the model say

is AHi4 now<|assistant_end|>ins

Makes it not say

Once They all wanted# uponier how

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.33
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "test_text.
  2. agent 3.29
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "test_strings.
  3. agent 3.28
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "test_items.
  4. agent 3.27
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "test_calc.
  5. agent 3.25
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "test_stats.
  6. agent 3.24
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "test_tools.
  7. agent 3.22
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "hello.py",
  8. agent 3.2
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "test_calc.
  9. agent 3.2
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "test_calc.
  10. agent 3.2
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "test_helpers.
  11. agent 3.19
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "test_stats.
  12. agent 3.19
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "test_utils.