Skip to content
mini-lab
Features of prelude-2

Feature #4069

Fires on “from” (not labeled yet: read the examples)

Fires on
0.20% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 94%
  • story 3%
  • agent 1%
  • chat 1%
  • worksheet 1%

Makes the model say

see more I both hard Maxprint but

Makes it not say

):<|system_end|> prelude<|tool_call_start|>replaceAllSet_ coding

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 7.11
    3)⏎-3⏎<|bos|># test_calc.py⏎from calc import min_
  2. python 7.0
    .py`.<|assistant_end|><|bos|># test_words.py⏎from words import exclaim,
  3. python 6.98
    ⏎12⏎```<|assistant_end|><|bos|># test_helpers.py⏎from helpers import first,
  4. python 6.94
    0<|think_end|>910<|assistant_end|><|bos|># test_textlib.py⏎from textlib import echo,
  5. python 6.86
    ```⏎hello⏎```<|assistant_end|><|bos|># test_tools.py⏎from tools import whisper⏎
  6. python 6.76
    for another story soon.<|assistant_end|><|bos|># test_words.py⏎from words import final_
  7. python 6.71
    is 88.<|assistant_end|><|bos|># test_lists.py⏎from lists import keep_
  8. python 6.61
    STAR"))⏎⏎# test_strings.py⏎from strings import whisper⏎
  9. python 6.59
    together every day.<|bos|># test_number_utils.py⏎from number_utils import
  10. python 6.58
    7, 6))⏎⏎# test_ops.py⏎from ops import add,
  11. python 6.58
    ave a nice day.<|assistant_end|><|bos|># test_lists.py⏎from lists import has_
  12. python 6.46
    add numbers.<|assistant_end|><|bos|># test_number_utils.py⏎from number_utils import