Skip to content
mini-lab
Features of prelude-2

Feature #535

Fires on “`:” (not labeled yet: read the examples)

Fires on
0.48% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 72%
  • python 20%
  • chat 6%
  • story 1%
  • worksheet 0%

Makes the model say

Set`,RenamedoldString multipl typoexpressionFixed

Makes it not say

's small asked lots took a could felt

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.76
    ⏎<|tool_end|><|assistant_start|>Fixed `abs_value` in `calc.py`: it used `return
  2. agent 2.71
    tests passed⏎<|tool_end|><|assistant_start|>Fixed `larger` in `lib.py`: it used `if
  3. agent 2.7
    ⏎<|tool_end|><|assistant_start|>Fixed `min_item` in `stats.py`: it used `return
  4. agent 2.69
    tests passed⏎<|tool_end|><|assistant_start|>Fixed `fact` in `utils.py`: it used `for
  5. agent 2.69
    tests passed⏎<|tool_end|><|assistant_start|>Fixed `reverse` in `lib.py`: it used `return
  6. agent 2.68
    ⏎<|tool_end|><|assistant_start|>Fixed `is_odd` in `utils.py`: it used `return
  7. agent 2.67
    tests passed⏎<|tool_end|><|assistant_start|>Fixed `twice` in `tools.py`: it used `return
  8. agent 2.66
    tests passed⏎<|tool_end|><|assistant_start|>Fixed `power` in `utils.py`: it used `return
  9. agent 2.66
    ⏎<|tool_end|><|assistant_start|>Fixed `sub_one` in `tools.py`: it used `return
  10. agent 2.65
    ⏎<|tool_end|><|assistant_start|>Fixed `max_of` in `calc.py`: it used `if
  11. agent 2.65
    tests passed⏎<|tool_end|><|assistant_start|>Fixed `shout` in `utils.py`: it used `return
  12. agent 2.65
    ⏎<|tool_end|><|assistant_start|>Fixed `num_chars` in `greetings.py`: it used `return