Skip to content
mini-lab
Features of prelude-2

Feature #3145

Fires on “.” (not labeled yet: read the examples)

Fires on
1.12% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 64%
  • python 27%
  • story 7%
  • chat 1%
  • worksheet 1%

Makes the model say

Pythononfigtxt still not stepped outside tried

Makes it not say

)]red moralThank home returnprint

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 3.16
    , 6, 8]⏎22⏎<|bos|># utils.py⏎def sub
  2. python 3.06
    513<|think_end|>513<|assistant_end|><|bos|># tools.py⏎def hello
  3. python 3.05
    py`.<|assistant_end|><|bos|># tools.py⏎def repeat
  4. python 3.0
    .py⏎24⏎5⏎-1⏎<|bos|># lib.py⏎def min
  5. python 2.94
    home sad.<|bos|># utils.py⏎def abs
  6. python 2.9
    (backwards("star"))⏎⏎# items.py⏎def double
  7. python 2.87
    # Tiny utils⏎⏎A small Python project.⏎⏎# utils.py⏎def halve
  8. python 2.84
    passes: all tests passed.<|assistant_end|><|bos|># lib.py⏎def echo
  9. python 2.83
    ):⏎ result = result * i⏎ return result⏎⏎# lists.py⏎def tail
  10. python 2.78
    add numbers.<|assistant_end|><|bos|># listlib.py⏎def biggest
  11. python 2.78
    print(lower_case("MOON"))⏎⏎# textlib.py⏎def welcome
  12. python 2.77
    b):⏎ return a + " " + b⏎⏎# textlib.py⏎def quiet