Feature #1571
Fires on “ s” (not labeled yet: read the examples)
- Fires on
- 0.46% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 48%
- python 28%
- chat 17%
- worksheet 4%
- story 2%
Makes the model say
[ x[::<|system_start|>ly echoag In
Makes it not say
I to bird, for he told give
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 3.17Bug: `flip` should reverse s, but it has `return s[1:]`.
-
python 3.16Bug: `flip` should reverse s, but it has `return s[::1]`.⏎
-
python 3.08Bug: `flip` should reverse s, but it has `return s[::1]`.⏎
-
python 3.06Bug: `reverse` should reverse s, but it has `return s[1:]`.
-
python 3.03Bug: `reverse` should reverse s, but it has `return s[1:]`.
-
python 3.01: `square` should return x squared, but it has `return x + x`.⏎
-
python 2.97Bug: `reverse` should reverse s, but it has `return s[1:]`.
-
python 2.96Bug: `flip` should reverse s, but it has `return s[1:]`.
-
python 2.82` should return True if x is odd, but it has `return x % 2 ==
-
python 2.75`flip` should return s reversed, but it has `return s[::1]`.⏎
-
python 2.75: `square` should return x squared, but it has `return x * 2`.
-
python 2.73: `squared` should return x squared, but it has `return x * 2`.