Skip to content
mini-lab
Features of prelude-2

Feature #3551

Fires on “test” (not labeled yet: read the examples)

Fires on
0.48% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 75%
  • python 17%
  • story 5%
  • chat 2%
  • worksheet 2%

Makes the model say

terustivey farm here that each

Makes it not say

⏎(-expression]`$,"'re Everyone

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.27
    <|tool_start|>all tests passed⏎<|tool_end|><|assistant_start|>`test_tools.py
  2. agent 2.18
    tests passed⏎<|tool_end|><|assistant_start|>`test_ops.py
  3. python 2.12
    def smallest(nums):⏎ return min(nums)⏎<|bos|>`sum_list(nums
  4. python 2.12
    <|assistant_start|>Hello! What should we do in this project?<|assistant_end|><|bos|>`times(a,
  5. python 2.05
    `negate(5)` returns `-5`.⏎⏎`multiply(a,
  6. agent 2.03
    passed⏎<|tool_end|><|assistant_start|>`test_words.py
  7. agent 2.02
    _greetings.py<|tool_call_end|><|assistant_end|><|tool_start|>all tests passed⏎<|tool_end|><|assistant_start|>`test_greetings.py
  8. agent 2.02
    _tools.py<|tool_call_end|><|assistant_end|><|tool_start|>all tests passed⏎<|tool_end|><|assistant_start|>`test_tools.py
  9. python 1.93
    <|assistant_end|><|tool_start|>9<|tool_end|><|assistant_start|>The answer is 9.<|assistant_end|><|bos|>`raise_to(a
  10. agent 1.89
    <|assistant_end|><|tool_start|>Found 1 matches⏎tools.py
  11. agent 1.87
    <|arg|>pattern=def absolute<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎number_utils
  12. agent 1.87
    quiet<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎utils.py