Skip to content
mini-lab
Features of prelude-2

Feature #3205

Fires on “_” (not labeled yet: read the examples)

Fires on
0.68% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 60%
  • agent 34%
  • story 3%
  • chat 2%
  • worksheet 0%

Makes the model say

minusMIT preludemin_ whether reveronfig

Makes it not say

as adventure somethingw but someWhile box

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 5.63
    ⏎# test_number_utils.
  2. python 5.21
    2⏎⏎# test_helpers.py⏎
  3. python 5.17
    $ python3 test_lib.py
  4. python 5.09
    project.⏎⏎# test_stats.py⏎
  5. python 5.07
    3)⏎-3⏎<|bos|># test_calc.py⏎
  6. python 5.03
    ⏎$ python3 test_items.py
  7. python 5.02
    .txt⏎Remember to run the tests.⏎⏎# test_number_utils.
  8. python 4.97
    + b⏎⏎$ python3 test_core.py
  9. python 4.9
    x⏎ return x⏎⏎# test_ops.py⏎
  10. python 4.85
    88<|think_end|>The answer is 88.<|assistant_end|><|bos|># test_lists.py⏎
  11. python 4.8
    .json⏎{"debug": false}⏎⏎# test_lists.py⏎
  12. python 4.72
    :⏎```⏎True⏎12⏎```<|assistant_end|><|bos|># test_helpers.py⏎