Skip to content
mini-lab
Features of prelude-2

Feature #1907

Fires on “_” (not labeled yet: read the examples)

Fires on
1.16% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 73%
  • python 21%
  • story 4%
  • chat 2%
  • worksheet 1%

Makes the model say

utilsonedemo preludece others subtractcontent

Makes it not say

, still happy P#:`def

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 6.66
    $ python3 test_lib.py⏎
  2. python 6.04
    88<|think_end|>The answer is 88.<|assistant_end|><|bos|># test_lists.py⏎
  3. agent 6.03
    test_text.py<|tool_call_end|>
  4. agent 6.03
    test_mathlib.py pass
  5. python 6.03
    test_listlib.py⏎
  6. agent 6.03
    test_listlib.py<|tool_call_end|>
  7. python 5.95
    9, 910<|think_end|>910<|assistant_end|><|bos|># test_textlib.py⏎
  8. python 5.85
    ⏎$ python3 test_items.py⏎
  9. python 5.84
    .txt⏎Remember to run the tests.⏎⏎# test_number_utils.
  10. python 5.83
    3)⏎-3⏎<|bos|># test_calc.py⏎
  11. python 5.64
    :⏎```⏎True⏎12⏎```<|assistant_end|><|bos|># test_helpers.py⏎
  12. agent 5.63
    Edited test_text.py (