Feature #3839
Fires on “⏎” (not labeled yet: read the examples)
- Fires on
- 0.74% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 79%
- agent 16%
- story 2%
- chat 2%
- worksheet 1%
Makes the model say
fromdef tests project Python should +=
Makes it not say
itob longthat]))el people
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 3.93py` with `head(items)`.<|assistant_end|><|bos|># mathlib.py⏎def fact(n
-
python 3.89py` with `last(items)`.<|assistant_end|><|bos|># items.py⏎def double_all
-
python 3.83Have a nice day.<|assistant_end|><|bos|># textlib.py⏎def size(s
-
python 3.82home sad.<|bos|># utils.py⏎def abs_value
-
python 3.81with `sub_one(x)`.<|assistant_end|><|bos|># words.py⏎def whisper(s
-
python 3.78py`.<|assistant_end|><|bos|># tools.py⏎def repeat(s
-
python 3.76513<|think_end|>513<|assistant_end|><|bos|># tools.py⏎def hello(name
-
python 3.7110<|think_end|>910<|assistant_end|><|bos|># test_textlib.py⏎from textlib import echo
-
python 3.64answer is 88.<|assistant_end|><|bos|># test_lists.py⏎from lists import keep
-
python 3.62and `total(nums)`.<|assistant_end|><|bos|># test_words.py⏎from words import count
-
python 3.62.py`.<|assistant_end|><|bos|># test_words.py⏎from words import exclaim
-
python 3.61passes: all tests passed.<|assistant_end|><|bos|># lib.py⏎def echo(s