Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3428

Fires on “ last” (not labeled yet: read the examples)

Fires on
0.61% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 77%
  • chat 10%
  • python 6%
  • story 6%
  • worksheet 0%

Makes the model say

tests project timesce functions were years main

Makes it not say

+ upon plus wayassert +plain gets

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.79
    <|tool_start|>Traceback (most recent call last):⏎ File "
  2. agent 2.79
    <|tool_start|>Traceback (most recent call last):⏎ File "
  3. agent 2.79
    <|tool_start|>Traceback (most recent call last):⏎ File "
  4. agent 2.73
    Traceback (most recent call last):⏎ File "
  5. agent 2.57
    only knows small Python projects. I can
  6. agent 2.55
    test_text.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  7. agent 2.53
    py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  8. agent 2.45
    _strings.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  9. agent 2.38
    3 test_text.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  10. agent 2.37
    3 test_tools.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  11. agent 2.37
    3 test_greetings.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "
  12. agent 2.37
    3 test_lists.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "