Skip to content
mini-lab
Features of prelude-2

Feature #1418

Fires on “from” (not labeled yet: read the examples)

Fires on
0.28% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 84%
  • python 12%
  • story 3%
  • chat 1%
  • worksheet 1%

Makes the model say

<|tool_call_start|> to otheric owns sO

Makes it not say

=0ape Python tests Falsenderarith

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 1.58
    <|assistant_end|><|tool_start|>Edited number_utils.py (1 replacement)<|tool_end|><|assistant_start|>Added `absolute(x
  2. python 1.56
    test_listlib.py⏎from listlib import head⏎
  3. python 1.48
    .json"⏎}⏎⏎# test_tools.py⏎from tools import flip,
  4. python 1.47
    than having many things.<|assistant_end|><|bos|># test_calc.py⏎from calc import times,
  5. agent 1.46
    _utils.py (1 replacement)<|tool_end|><|assistant_start|>Added `negate(x
  6. python 1.44
    requirements.txt⏎pytest⏎⏎# test_tools.py⏎from tools import factorial,
  7. python 1.42
    were safe and happy together.<|bos|># test_tools.py⏎from tools import square,
  8. agent 1.42
    b<|tool_call_end|><|assistant_end|><|tool_start|>Edited app.py (1 replacement)<|tool_end|><|assistant_start|>Added `min_of
  9. python 1.41
    ⏎# test_number_utils.py⏎from number_utils import
  10. python 1.41
    together every day.<|bos|># test_number_utils.py⏎from number_utils import
  11. agent 1.41
    b<|tool_call_end|><|assistant_end|><|tool_start|>Edited arith.py (1 replacement)<|tool_end|><|assistant_start|>Added `diffe
  12. python 1.4
    project.⏎⏎# test_stats.py⏎from stats import has_