Skip to content
mini-lab
Features of prelude-2

Feature #1859

Fires on “from” (not labeled yet: read the examples)

Fires on
0.16% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 50%
  • story 38%
  • chat 7%
  • agent 5%
  • worksheet 0%

Makes the model say

was is this new little own had were

Makes it not say

<|tool_call_start|>Fix<|arg|>Set trained<|think_start|><|user_start|>expression

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 5.09
    7, 6))⏎⏎# test_ops.py⏎from ops import add,
  2. python 5.02
    project.⏎⏎# test_stats.py⏎from stats import has_
  3. python 5.0
    0<|think_end|>910<|assistant_end|><|bos|># test_textlib.py⏎from textlib import echo,
  4. python 4.98
    ⏎12⏎```<|assistant_end|><|bos|># test_helpers.py⏎from helpers import first,
  5. python 4.94
    .py`.<|assistant_end|><|bos|># test_words.py⏎from words import exclaim,
  6. python 4.92
    .json"⏎}⏎⏎# test_tools.py⏎from tools import flip,
  7. python 4.9
    " + name + "!"⏎⏎# test_text.py⏎from text import whisper,
  8. python 4.9
    requirements.txt⏎pytest⏎⏎# test_tools.py⏎from tools import factorial,
  9. python 4.89
    2⏎⏎# test_helpers.py⏎from helpers import smaller,
  10. python 4.88
    (loud("house"))⏎⏎# test_text.py⏎from text import loud,
  11. python 4.87
    were safe and happy together.<|bos|># test_tools.py⏎from tools import square,
  12. python 4.86
    ```⏎hello⏎```<|assistant_end|><|bos|># test_tools.py⏎from tools import whisper⏎