Skip to content
mini-lab
Features of prelude-2

Feature #2596

Fires on “_” (not labeled yet: read the examples)

Fires on
0.18% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 60%
  • story 26%
  • agent 12%
  • chat 2%
  • worksheet 0%

Makes the model say

<|arg|> assertdemo happen prelude<|assistant_end|>

Makes it not say

't it alls car no was big

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 5.55
    3)⏎-3⏎<|bos|># test_calc.py⏎
  2. python 5.37
    ⏎# test_number_utils.
  3. python 5.32
    .txt⏎Remember to run the tests.⏎⏎# test_number_utils.
  4. python 5.27
    project.⏎⏎# test_stats.py⏎
  5. python 5.17
    x⏎ return x⏎⏎# test_ops.py⏎
  6. python 5.11
    first(items):⏎ return items[0]⏎⏎# test_helpers.py⏎
  7. python 5.06
    layground⏎⏎A small Python project.⏎⏎# test_calc.py⏎
  8. python 5.05
    .json⏎{"debug": false}⏎⏎# test_lists.py⏎
  9. python 5.0
    + b⏎⏎# requirements.txt⏎pytest⏎⏎# test_tools.py⏎
  10. python 4.99
    2⏎⏎# test_helpers.py⏎
  11. python 4.91
    9, 910<|think_end|>910<|assistant_end|><|bos|># test_textlib.py⏎
  12. python 4.84
    :⏎```⏎True⏎12⏎```<|assistant_end|><|bos|># test_helpers.py⏎