Feature #2449
Fires on “,” (not labeled yet: read the examples)
- Fires on
- 1.70% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 58%
- python 20%
- chat 16%
- worksheet 5%
- story 1%
Makes the model say
ut butai I replace there rolledas
Makes it not say
⏎ boy Tim<|bos|> return`Tim?
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 4.66def includes(items, x):⏎ return
-
python 4.65* 2 for n in nums]⏎⏎⏎def contains(items, x):⏎ return
-
python 4.56result = result * i⏎ return result⏎⏎⏎def plus(a, b):⏎
-
python 4.55(nums) / len(nums)⏎⏎⏎def contains(items, x):⏎ return
-
python 4.53He was proud and ready for school.<|assistant_end|><|bos|>`contains(items, x)` checks whether
-
python 4.49result = result * i⏎ return result⏎⏎⏎def repeat(s, n):⏎ return
-
python 4.47⏎def contains(items, x):⏎ return
-
python 4.43x):⏎ return x > 0⏎⏎⏎def product(a, b):⏎ return
-
python 4.3656.<|assistant_end|><|bos|># listlib.py⏎def includes(items, x):⏎ return
-
python 4.35s):⏎ return s.upper()⏎⏎⏎def repeat(s, n):⏎ return
-
python 4.33tell short stories and add numbers.<|assistant_end|><|bos|>`minus(a, b)` returns a
-
python 4.33to `lib.py`.<|assistant_end|><|bos|>`has_item(items, x)` returns True