Feature #1128
Fires on “ has” (not labeled yet: read the examples)
- Fires on
- 0.33% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 37%
- chat 32%
- story 22%
- agent 6%
- worksheet 2%
Makes the model say
hello only lots every fun allOnce lot
Makes it not say
.se wasaking<|assistant_end|>th stepped went
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 3.12` should return the average of a and b, but it has `return (a
-
python 3.1`mean_list` should return the average of nums, but it has `return sum(
-
python 3.07max_item` should return the biggest item of nums, but it has `return min(
-
python 3.02Bug: `fact` should return the factorial of n, but it has `result = result
-
python 3.0divisible` should return True if a is divisible by b, but it has `return a %
-
python 2.99: `exclaim` should add an exclamation mark to s, but it has `return s +
-
python 2.98: `doubled` should return every number of nums doubled, but it has `return [n
-
python 2.96`num_chars` should return the length of s, but it has `return len(
-
python 2.95Bug: `includes` should check whether items contains x, but it has `return x not
-
python 2.93Bug: `vowels` should count the vowels in s, but it has `k = k
-
python 2.93the sum of all the numbers from 0 to n, but it has `for i in
-
python 2.92` should add up the numbers from 0 to n, but it has `acc =