Feature #3702
Fires on “_” (not labeled yet: read the examples)
- Fires on
- 0.42% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 77%
- agent 10%
- story 7%
- chat 5%
- worksheet 0%
Makes the model say
Fixitemsde big loud Lineve friends
Makes it not say
w smiledifcontains# withYes.
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 5.6⏎# test_number_utils.
-
python 5.35py`.<|assistant_end|><|bos|># tools.py⏎def
-
python 5.342⏎⏎# test_helpers.py⏎
-
python 5.3513<|think_end|>513<|assistant_end|><|bos|># tools.py⏎def
-
python 5.24x⏎ return x⏎⏎# test_ops.py⏎
-
python 5.2<|tool_end|><|assistant_start|>The answer is 1656.<|assistant_end|><|bos|># listlib.py⏎def
-
python 5.17⏎print(lower_case("MOON"))⏎⏎# textlib.py⏎def
-
python 5.16project.⏎⏎# test_stats.py⏎
-
python 5.15home sad.<|bos|># utils.py⏎def
-
python 5.158, 6, 8]⏎22⏎<|bos|># utils.py⏎def
-
python 5.14shadows on the wall. They were happy and safe.<|bos|># tools.py⏎def
-
python 5.1first(items):⏎ return items[0]⏎⏎# test_helpers.py⏎