Feature #201
Fires on “```” (not labeled yet: read the examples)
- Fires on
- 0.56% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 59%
- agent 24%
- story 12%
- worksheet 3%
- chat 2%
Makes the model say
<|user_end|><|assistant_end|>````:command<|system_start|><|think_end|>json
Makes it not say
one of find<|bos|> and always when please
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 1.93(name):⏎ return "Hello, " + name + "!"⏎```⏎⏎`hello
-
python 1.89⏎def cubed(x):⏎ return x * x * x⏎```⏎⏎>>> cubed
-
python 1.87(name):⏎ return "Hello, " + name + "!"⏎```⏎⏎`welcome
-
story 1.83. She showed it to her dad and said, "Look, Dad! I made a present
-
python 1.82python⏎def reverse(s):⏎ return s[::-1]⏎```⏎⏎`reverse
-
python 1.81(name):⏎ return "Hello, " + name + "!"⏎```⏎⏎Bug:
-
python 1.81(name):⏎ return "Hello, " + name + "!"⏎```⏎⏎>>> hello
-
python 1.8python⏎def quiet(s):⏎ return s.lower()⏎```⏎⏎`quiet
-
python 1.8def lower_case(s):⏎ return s.upper()⏎```⏎⏎Fix:
-
python 1.8raise_to(a, b):⏎ return a ** b⏎```⏎<|bos|>Once upon
-
python 1.8⏎def power(a, b):⏎ return a * b⏎```⏎⏎Fix:
-
python 1.8python⏎def quiet(s):⏎ return s.upper()⏎```⏎⏎Fix: