Feature #2785
Fires on “What” (not labeled yet: read the examples)
- Fires on
- 1.57% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 38%
- agent 33%
- python 14%
- worksheet 9%
- story 5%
Makes the model say
is tests < from >oldString": tail
Makes it not say
D# tryverx sadrepeatre
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 6.372288 = 2353.<|bos|><|user_start|>What is 1 +
-
chat 6.289 + 844 = 853.<|bos|><|user_start|>What's the weather
-
chat 6.15, edit and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>What can you do?
-
chat 6.14400 = 39589.<|bos|><|user_start|>What is the sum of
-
chat 6.07. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>What is 36
-
chat 6.0and catch the ball, happy to be with his friends.<|bos|><|user_start|>What is 82
-
chat 5.95but by their actions and how they treat you.<|bos|><|user_start|>What is your name?
-
chat 5.896<|think_end|>The answer is 1006.<|assistant_end|><|bos|><|user_start|>What's your name?
-
chat 5.87, 9, 9])` returns `9`.⏎<|bos|><|user_start|>What can you do?
-
chat 5.8605<|think_end|>The answer is 505.<|assistant_end|><|bos|><|user_start|>What's your name?
-
chat 5.840⏎⏎$ python3 script.py⏎True⏎<|bos|><|user_start|>What is the capital
-
chat 5.82Try asking me for a story!<|assistant_end|><|bos|><|user_start|>What's your name?