Feature #3423
Fires on “_” (not labeled yet: read the examples)
- Fires on
- 0.68% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 37%
- agent 34%
- story 20%
- chat 6%
- worksheet 3%
Makes the model say
vowels words fast. timeitems way language
Makes it not say
lookdivisible seero table sit sawOh
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 3.573<|think_end|>The answer is 133.<|assistant_end|><|bos|>`count_items(items)`
-
python 3.47⏎def count_items(items):
-
python 3.42⏎⏎⏎def count_vowels(s):
-
python 3.370, 7])` returns `7`.⏎⏎`count_items(items)`
-
python 3.35⏎ return s.lower()⏎```⏎⏎Bug: `count_vowels` should return
-
python 3.34chars(s):⏎ return len(s)⏎⏎⏎def count_vowels(s):
-
python 3.34b):⏎ return a + " " + b⏎⏎⏎def count_vowels(s):
-
python 3.34):⏎ return s * n⏎```⏎⏎Bug: `count_vowels` should return
-
python 3.3result + n⏎ return result⏎```⏎⏎Bug: `count_items` should return
-
python 3.28count_vowels(s
-
python 3.24⏎ return s.upper()⏎```⏎⏎Bug: `count_vowels` should return
-
python 3.19[n * 2 for n in nums]⏎⏎⏎def count_vowels(s):