Skip to content
mini-lab
Features of prelude-2

Feature #703

Fires on “re” (not labeled yet: read the examples)

Fires on
0.75% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 76%
  • chat 14%
  • story 7%
  • worksheet 1%
  • python 1%

Makes the model say

patternppy[::d dog miniMIT

Makes it not say

shiny shapes knew working called next told heavy

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.79
    .<|system_end|><|user_start|>How does how_many work?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
  2. agent 3.77
    case.<|assistant_end|><|user_start|>Where can I find shout?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
  3. agent 3.77
    _length everywhere.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
  4. agent 3.75
    <|system_end|><|user_start|>Rename double_all to doubled everywhere.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
  5. agent 3.67
    to first_letter<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
  6. agent 3.67
    x)`.<|assistant_end|><|user_start|>Set LIMIT to 7<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
  7. agent 3.67
    rename the function negate to new_negate"<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
  8. agent 3.66
    [8, 6, 2].<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
  9. agent 3.64
    harness.<|system_end|><|user_start|>"How does smallest work?"<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
  10. agent 3.63
    harness.<|system_end|><|user_start|>Explain the function hello.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
  11. agent 3.63
    all the function new_excite instead of excite.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=
  12. agent 3.63
    <|user_start|>Call the function add instead of plus.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=