Feature #1993
Fires on “ `” (not labeled yet: read the examples)
- Fires on
- 1.06% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 70%
- python 22%
- worksheet 4%
- chat 2%
- story 2%
Makes the model say
command<|think_end|> `Setdemocalculator definespath
Makes it not say
ever read a take far un d they
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 2.01`doubled` should return every number of nums doubled, but it has `return [n +
-
python 1.91: `negate` should return the opposite of x, but it has `return x`.⏎
-
python 1.9⏎Bug: `negate` should return minus x, but it has `return x`.⏎
-
python 1.85for n in nums if n % 2 == 0]⏎⏎⏎def head(items
-
python 1.83: `opposite` should return the opposite of x, but it has `return x`.⏎
-
python 1.83_item` should return the biggest item of nums, but it has `return min(nums
-
python 1.82: `evens` should keep only the even numbers, but it has `return [n for
-
python 1.82for n in nums if n % 2 == 0]⏎⏎⏎SCORES = [6
-
python 1.81`exclaim` should add an exclamation mark to s, but it has `return s + "?"
-
python 1.79` should return True if a is divisible by b, but it has `return a % b
-
python 1.75only_even` should keep only the even numbers, but it has `return [n for
-
chat 1.7507⏎8+0: 8+0+1=9, 9