Skip to content
mini-lab
Features of prelude-2

Feature #3930

Fires on “:” (not labeled yet: read the examples)

Fires on
0.75% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 91%
  • python 6%
  • story 2%
  • chat 1%
  • worksheet 0%

Makes the model say

_ %:( dog over for <

Makes it not say

<|arg|>]))python<|think_end|><|tool_call_start|><|tool_end|><|think_start|>Sorry

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.91
    all tests passed⏎<|tool_end|><|assistant_start|>`test_utils.py` passes: all tests passed.
  2. agent 2.88
    all tests passed⏎<|tool_end|><|assistant_start|>`test_lists.py` passes: all tests passed.
  3. agent 2.88
    all tests passed⏎<|tool_end|><|assistant_start|>`test_items.py` passes: all tests passed.
  4. agent 2.86
    all tests passed⏎<|tool_end|><|assistant_start|>`test_core.py` passes: all tests passed.
  5. agent 2.85
    all tests passed⏎<|tool_end|><|assistant_start|>`test_stats.py` passes: all tests passed.
  6. agent 2.84
    passed⏎<|tool_end|><|assistant_start|>`test_math_utils.py` passes: all tests passed.
  7. agent 2.83
    all tests passed⏎<|tool_end|><|assistant_start|>`test_tools.py` passes: all tests passed.
  8. agent 2.83
    all tests passed⏎<|tool_end|><|assistant_start|>`test_utils.py` passes: all tests passed.
  9. agent 2.82
    all tests passed⏎<|tool_end|><|assistant_start|>`test_lib.py` passes: all tests passed.
  10. agent 2.82
    passed⏎<|tool_end|><|assistant_start|>`test_math_utils.py` passes: all tests passed.
  11. agent 2.82
    all tests passed⏎<|tool_end|><|assistant_start|>`test_arith.py` passes: all tests passed.
  12. agent 2.81
    passed⏎<|tool_end|><|assistant_start|>`test_number_utils.py` passes: all tests passed.