Skip to content
mini-lab
Features of prelude-2

Feature #362

Fires on “ text” (not labeled yet: read the examples)

Fires on
0.35% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 53%
  • agent 40%
  • story 4%
  • chat 3%
  • worksheet 0%

Makes the model say

import typo functiongr sing":ue

Makes it not say

$ they she bug# flew returns so

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 5.49
    from text import count_vowels
  2. python 5.25
    ⏎```⏎True⏎```<|assistant_end|><|bos|># main.py⏎from lib import length, halve
  3. python 5.23
    , " + name + "!"⏎⏎# main.py⏎from lib import hello⏎⏎
  4. python 5.12
    answer is 41.<|assistant_end|><|bos|># main.py⏎from text import echo⏎⏎
  5. python 5.06
    script.py⏎from utils import join_words, square⏎from words import count_vowels
  6. python 5.05
    12⏎```<|assistant_end|><|bos|># test_helpers.py⏎from helpers import first, increment
  7. python 5.02
    print("all tests passed")⏎⏎# main.py⏎from text import reverse⏎⏎
  8. python 4.96
    I help with your code?<|assistant_end|><|bos|># demo.py⏎from helpers import sub_one
  9. python 4.93
    loud("house"))⏎⏎# test_text.py⏎from text import loud, initial
  10. python 4.91
    Python files in this project.<|assistant_end|><|bos|># main.py⏎from lib import magnitude⏎⏎
  11. python 4.9
    and `core.py`.<|assistant_end|><|bos|># demo.py⏎from words import flip, final
  12. python 4.89
    ⏎hello⏎```<|assistant_end|><|bos|># test_tools.py⏎from tools import whisper⏎⏎