Skip to content
mini-lab
Features of prelude-2

Feature #721

Fires on “py” (not labeled yet: read the examples)

Fires on
1.93% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 82%
  • agent 14%
  • story 1%
  • worksheet 1%
  • chat 1%

Makes the model say

⏎ try project}⏎ where `")

Makes it not say

uponSarareat eachth playedri them

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 6.75
    The other animals did not laugh at him anymore.<|bos|># strings.py⏎def reverse(
  2. python 6.68
    on the wall. They were happy and safe.<|bos|># tools.py⏎def first(
  3. python 6.59
    Have a nice day.<|assistant_end|><|bos|># textlib.py⏎def size(
  4. python 6.55
    ):⏎ return a % b == 0⏎⏎# text.py⏎def greet(
  5. python 6.55
    6<|think_end|>The answer is 76.<|assistant_end|><|bos|># strings.py⏎def hello(
  6. python 6.54
    (lower_case("MOON"))⏎⏎# textlib.py⏎def welcome(
  7. python 6.54
    (backwards("star"))⏎⏎# items.py⏎def double_
  8. python 6.46
    (10, 1))⏎⏎# math_utils.py⏎def add(
  9. python 6.46
    ce(4, 4))⏎⏎# math_utils.py⏎def sum_
  10. python 6.46
    /config.json"⏎}⏎⏎# number_utils.py⏎def even(
  11. python 6.46
    n * 2 for n in nums]⏎⏎# text.py⏎def hello(
  12. python 6.43
    ` with `sub_one(x)`.<|assistant_end|><|bos|># words.py⏎def whisper(