Skip to content
mini-lab
Features of prelude-2

Feature #1121

Fires on “.” (not labeled yet: read the examples)

Fires on
0.56% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 48%
  • python 37%
  • chat 12%
  • story 2%
  • worksheet 0%

Makes the model say

pathnewStringAdded`,!")<|system_start|>ousful

Makes it not say

.0 but45 Falsece

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 3.58
    ⏎{"debug": false}⏎⏎# test_textlib.py⏎from textlib
  2. python 3.52
    4, 0]⏎5⏎$ python3 test_listlib.py⏎all tests
  3. python 3.48
    s):⏎ return s[0]⏎⏎# test_textlib.py⏎from textlib
  4. python 3.44
    _words("apple", "cloud"))⏎⏎# test_textlib.py⏎from textlib
  5. python 3.43
    (nums) / len(nums)⏎⏎# test_listlib.py⏎from listlib
  6. python 3.31
    print(final_letter("tree"))⏎⏎# test_strings.py⏎from strings
  7. python 3.3
    n % 2 == 0]⏎⏎# test_strings.py⏎from strings
  8. python 3.28
    config.json"⏎}⏎⏎$ python3 test_stats.py⏎all tests
  9. python 3.26
    (echo("tree", 2))⏎⏎# test_textlib.py⏎from textlib
  10. python 3.24
    s):⏎ return s[::-1]⏎⏎# test_strings.py⏎from strings
  11. python 3.23
    2]` in `main.py`.<|assistant_end|><|bos|># test_listlib.py⏎from listlib
  12. python 3.22
    n % 2 == 0]⏎⏎# test_listlib.py⏎from listlib