Skip to content
mini-lab
Features of prelude-2

Feature #1180

Fires on “_” (not labeled yet: read the examples)

Fires on
0.48% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 54%
  • python 30%
  • story 12%
  • chat 3%
  • worksheet 1%

Makes the model say

The of friends the =Themath⏎

Makes it not say

<|think_end|>newStringcommand<|tool_call_end|>)`. "!"`.replaceAll<|user_start|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 2.34
    the same again.<|bos|># number_utils.py⏎def sum_up_to(
  2. python 2.3
    acc = acc + i⏎ return acc⏎```⏎⏎`sum_up_to`
  3. python 2.29
    result = result + n⏎ return result⏎```⏎⏎`sum_list` adds up
  4. agent 2.27
    tests passed⏎<|tool_end|><|assistant_start|>`test_ops.py`
  5. agent 2.26
    <|tool_start|>all tests passed⏎<|tool_end|><|assistant_start|>`test_tools.py`
  6. python 2.24
    .txt⏎Remember to run the tests.⏎⏎# test_number_utils.
  7. python 2.24
    acc = acc + i⏎ return acc⏎```⏎⏎`sum_up_to`
  8. agent 2.23
    passed⏎<|tool_end|><|assistant_start|>`test_words.py`
  9. python 2.22
    .json⏎{"debug": false}⏎⏎# test_lists.py⏎
  10. python 2.21
    acc = acc + i⏎ return acc⏎```⏎⏎`sum_up_to`
  11. python 2.19
    ⏎all tests passed⏎$ python3 test_items.py⏎
  12. python 2.19
    10, 14, 2]`.⏎⏎`sum_two(a,