Skip to content
mini-lab
Features of prelude-2

Feature #51

Fires on “.” (not labeled yet: read the examples)

Fires on
1.26% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 68%
  • python 22%
  • chat 5%
  • story 4%
  • worksheet 1%

Makes the model say

pyutilsmdjsonlistsite list(

Makes it not say

idea") / z magic```aeiou#

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 5.88
    project⏎⏎A small Python project.⏎⏎# test_listlib.py⏎from listlib
  2. python 5.83
    <|think_end|>The answer is 88.<|assistant_end|><|bos|># test_lists.py⏎from lists
  3. python 5.68
    md` and `textlib.py`.<|assistant_end|><|bos|># test_core.py⏎from core
  4. python 5.6
    5, 8], 5))⏎⏎# test_listlib.py⏎from listlib
  5. python 5.55
    ⏎{"debug": false}⏎⏎# test_textlib.py⏎from textlib
  6. python 5.54
    2]` in `main.py`.<|assistant_end|><|bos|># test_listlib.py⏎from listlib
  7. python 5.53
    (echo("tree", 2))⏎⏎# test_textlib.py⏎from textlib
  8. python 5.53
    _words("apple", "cloud"))⏎⏎# test_textlib.py⏎from textlib
  9. python 5.49
    How can I help with your code?<|assistant_end|><|bos|># test_textlib.py⏎from textlib
  10. python 5.47
    910<|think_end|>910<|assistant_end|><|bos|># test_textlib.py⏎from textlib
  11. python 5.47
    print(final_letter("tree"))⏎⏎# test_strings.py⏎from strings
  12. python 5.46
    4, 3, 7]))⏎⏎# test_listlib.py⏎from listlib