Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2553

Fires on “py” (not labeled yet: read the examples)

Fires on
0.69% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 75%
  • agent 14%
  • chat 9%
  • story 2%
  • worksheet 0%

Makes the model say

" In really liked InsideOnce wanted want

Makes it not say

98.returnread<|tool_call_end|>," absolute

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 5.16
    ` with `sub_one(x)`.<|assistant_end|><|bos|># words.py⏎def whisper(
  2. python 4.74
    .py` with `last(items)`.<|assistant_end|><|bos|># items.py⏎def double_
  3. python 4.72
    (backwards("star"))⏎⏎# items.py⏎def double_
  4. python 4.63
    py`.<|assistant_end|><|bos|># tools.py⏎def repeat(
  5. python 4.62
    Have a nice day.<|assistant_end|><|bos|># textlib.py⏎def size(
  6. python 4.59
    6, 8]⏎22⏎<|bos|># utils.py⏎def sub_
  7. python 4.59
    on the wall. They were happy and safe.<|bos|># tools.py⏎def first(
  8. python 4.58
    The answer is 1656.<|assistant_end|><|bos|># listlib.py⏎def includes(
  9. python 4.54
    513<|think_end|>513<|assistant_end|><|bos|># tools.py⏎def hello(
  10. python 4.54
    ` and `test_ops.py`.<|assistant_end|><|bos|># textlib.py⏎def length(
  11. python 4.53
    Lily felt happy every time she looked at it.<|bos|># words.py⏎def length(
  12. python 4.5
    3, 4, 2]))⏎⏎# core.py⏎def last(