Feature #673
Fires on “ `” (not labeled yet: read the examples)
- Fires on
- 0.97% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 37%
- agent 28%
- chat 16%
- worksheet 11%
- story 7%
Makes the model say
return<|assistant_start|>resultOnce subtractitedIZEcalculator
Makes it not say
they5. we's21?
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 4.37`exclaim` should add an exclamation mark to s, but it has `return s + "?"
-
python 4.23Bug: `loud` should make s upper case, but it has `return s`.⏎
-
python 4.18: `includes` should check whether items contains x, but it has `return x not in
-
python 4.1combine` should join a and b with a space, but it has `return b + "
-
python 4.09`odd` should return True if x is odd, but it has `return x %
-
python 4.07Bug: `add` should add a and b, but it has `return a + a
-
python 4.07Bug: `loud` should make s upper case, but it has `return
-
python 4.05: `greet` should return a greeting for name, but it has `return "Hello,
-
python 4.04Bug: `welcome` should say hello to name, but it has `return "Hello,
-
python 4.02Bug: `previous` should return x minus one, but it has `return x +
-
python 4.01_even` should return True if x is even, but it has `return x %
-
python 4.0upper_case` should return s in upper case, but it has `return s.lower