Feature #3633
Fires on “ has” (not labeled yet: read the examples)
- Fires on
- 3.15% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 50%
- python 42%
- story 3%
- chat 3%
- worksheet 1%
Makes the model say
` replacemdpy<|assistant_end|> calculatorase_
Makes it not say
waitedly stayreiric or.
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 10.66: `doubled` should return every number of nums doubled, but it has `return [n
-
python 10.63: I can only tell short stories and add numbers.<|assistant_end|><|bos|>Bug: `lower_case
-
python 10.59`how_many(items)` counts the items.<|assistant_end|><|bos|>Bug: `combine` should
-
python 10.38`keep_even` should keep only the even numbers, but it has `return [n
-
python 10.12divisible` should return True if a is divisible by b, but it has `return a %
-
python 10.12` defines 1 function: `factorial(n)`.<|assistant_end|><|bos|>Bug: `upper_case
-
python 10.09difference` should return a minus b, but it has `return a +
-
python 10.03divisible` should return True if a is divisible by b, but it has `return a %
-
python 10.03Bug: `evens` should keep only the even numbers, but it has `return [n
-
python 10.0min_item` should return the smallest number in nums, but it has `return max(
-
python 10.0`keep_even` should keep only the even numbers, but it has `return [n
-
python 9.98<|bos|>Bug: `welcome` should say hello to name, but it has `return "Hello