Feature #1447
Fires on “ return” (not labeled yet: read the examples)
- Fires on
- 0.29% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 72%
- story 12%
- agent 9%
- worksheet 4%
- chat 2%
Makes the model say
tests he day sad the his leftow
Makes it not say
oneFix us subtractassert equals],H
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 3.41Bug: `mean_list` should return the average of nums
-
python 3.36```⏎<|bos|>Bug: `mean_list` should return the average of nums
-
python 3.25" " + b⏎```⏎⏎Bug: `vowels` should return the number of vowels
-
python 3.21OT⏎```<|assistant_end|><|bos|>Bug: `average_list` should return the average of nums
-
python 3.19s.upper()⏎```⏎⏎Bug: `vowels` should return the number of vowels
-
python 3.14return a * b⏎```⏎⏎Bug: `cubed` should return the cube of x
-
python 3.11s[::-1]⏎```⏎⏎Bug: `vowels` should return the number of vowels
-
python 3.11items)⏎```⏎⏎Bug: `average_list` should return the average of nums
-
python 3.080]⏎```⏎⏎Bug: `mean_list` should return the average of nums
-
python 3.062 == 1⏎```⏎⏎Bug: `cube` should return x cubed, but
-
python 3.05You're welcome!<|assistant_end|><|bos|>Bug: `average_list` should return the average of nums
-
python 3.03lower()⏎```⏎⏎Bug: `count_vowels` should return the number of vowels