Feature #721
Fires on “py” (not labeled yet: read the examples)
- Fires on
- 1.93% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 82%
- agent 14%
- story 1%
- worksheet 1%
- chat 1%
Makes the model say
⏎ try project}⏎ where `")
Makes it not say
uponSarareat eachth playedri them
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 6.75The other animals did not laugh at him anymore.<|bos|># strings.py⏎def reverse(
-
python 6.68on the wall. They were happy and safe.<|bos|># tools.py⏎def first(
-
python 6.59Have a nice day.<|assistant_end|><|bos|># textlib.py⏎def size(
-
python 6.55):⏎ return a % b == 0⏎⏎# text.py⏎def greet(
-
python 6.556<|think_end|>The answer is 76.<|assistant_end|><|bos|># strings.py⏎def hello(
-
python 6.54(lower_case("MOON"))⏎⏎# textlib.py⏎def welcome(
-
python 6.54(backwards("star"))⏎⏎# items.py⏎def double_
-
python 6.46(10, 1))⏎⏎# math_utils.py⏎def add(
-
python 6.46ce(4, 4))⏎⏎# math_utils.py⏎def sum_
-
python 6.46/config.json"⏎}⏎⏎# number_utils.py⏎def even(
-
python 6.46n * 2 for n in nums]⏎⏎# text.py⏎def hello(
-
python 6.43` with `sub_one(x)`.<|assistant_end|><|bos|># words.py⏎def whisper(