Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3305

Fires on “ last” (not labeled yet: read the examples)

Fires on
0.51% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 82%
  • chat 11%
  • story 6%
  • python 1%
  • worksheet 0%

Makes the model say

offles rest fire to showprint ch

Makes it not say

ite walk")`orroom way streetselves

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.68
    test_text.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  2. agent 3.52
    3 test_greetings.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  3. agent 3.5
    3 test_listlib.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  4. agent 3.49
    3 test_text.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  5. agent 3.48
    3 test_items.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  6. agent 3.48
    3 test_items.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  7. agent 3.47
    3 test_stats.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  8. agent 3.47
    3 test_calc.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  9. agent 3.47
    3 test_calc.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  10. agent 3.46
    3 test_items.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  11. agent 3.46
    3 test_greetings.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  12. agent 3.46
    3 test_listlib.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "