Skip to content
mini-lab
Features of prelude-2

Feature #1341

Fires on “ test” (not labeled yet: read the examples)

Fires on
0.45% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 44%
  • python 34%
  • story 19%
  • chat 2%
  • worksheet 1%

Makes the model say

_( test<|assistant_end|> next laptop filespattern

Makes it not say

ouFalsewarlprintexclaimth

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 4.71
    + b⏎⏎$ python3 test_core.py
  2. python 4.69
    ⏎$ python3 test_items.py
  3. python 4.52
    ⏎10⏎$ python3 test_number_utils
  4. python 4.48
    4, 0]⏎5⏎$ python3 test_listlib.py
  5. python 4.43
    $ python3 test_lib.py
  6. python 4.41
    =9, 910<|think_end|>910<|assistant_end|><|bos|># test_textlib.py
  7. python 4.4
    23⏎print("all tests passed")⏎⏎$ python3 test_calc.py
  8. python 4.35
    ⏎all tests passed⏎$ python3 test_items.py
  9. python 4.33
    . I can only tell short stories and add numbers.<|assistant_end|><|bos|># test_number_utils
  10. python 4.3
    88<|think_end|>The answer is 88.<|assistant_end|><|bos|># test_lists.py
  11. python 4.29
    They played and studied the forest together every day.<|bos|># test_number_utils
  12. python 4.28
    4.⏎0 + 16 = 16<|bos|># test_helpers.py