Skip to content
mini-lab
Features of prelude-2

Feature #833

Fires on “def” (not labeled yet: read the examples)

Fires on
0.22% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 84%
  • python 12%
  • story 2%
  • chat 1%
  • worksheet 0%

Makes the model say

replaceAlldef dreamschema*=**/ lived+

Makes it not say

3!0ap82 averageion

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.36
    plain the function hello.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def hello<|tool_call_end|><|assistant_end|><|tool_start|>
  2. agent 3.34
    Which file defines fact?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def fact<|tool_call_end|><|assistant_end|><|tool_start|>
  3. agent 3.33
    _up_to?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def sum_up_
  4. python 3.33
    _to(n):⏎ acc = 0⏎ for i in range(n +
  5. agent 3.26
    function double_all.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def double_all<|tool_call_end|>
  6. agent 3.25
    Which file defines odd?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def odd<|tool_call_end|><|assistant_end|><|tool_start|>
  7. agent 3.25
    find last_letter?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def last_letter<|tool_call_end|>
  8. agent 3.24
    can I find odd?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def odd<|tool_call_end|><|assistant_end|><|tool_start|>
  9. agent 3.23
    Which file defines square?"<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def square<|tool_call_end|><|assistant_end|><|tool_start|>
  10. agent 3.21
    plain the function product.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def product<|tool_call_end|><|assistant_end|><|tool_start|>
  11. agent 3.21
    add_one defined?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def add_one<|tool_call_end|>
  12. agent 3.2
    sum_two return?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def sum_two<|tool_call_end|>