Feature #3772
Fires on “What” (not labeled yet: read the examples)
- Fires on
- 0.75% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 66%
- agent 20%
- worksheet 12%
- python 2%
- story 1%
Makes the model say
add tell sum_ insideal there know
Makes it not say
turns$ looked then //ag boyva
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 4.81I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>What is the sum of
-
chat 4.8tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is your name?
-
chat 4.76. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>What is 36
-
chat 4.7` with `max_of(a, b)`.<|assistant_end|><|bos|><|user_start|>What is the sum of
-
chat 4.69Try asking me for a story!<|assistant_end|><|bos|><|user_start|>What's your name?
-
chat 4.69short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is 12
-
chat 4.682288 = 2353.<|bos|><|user_start|>What is 1 +
-
chat 4.676<|think_end|>The answer is 1006.<|assistant_end|><|bos|><|user_start|>What's your name?
-
chat 4.669 + 844 = 853.<|bos|><|user_start|>What's the weather
-
chat 4.64400 = 39589.<|bos|><|user_start|>What is the sum of
-
chat 4.62+3=3, 39<|think_end|>39<|assistant_end|><|bos|><|user_start|>What is 12
-
chat 4.5605<|think_end|>The answer is 505.<|assistant_end|><|bos|><|user_start|>What's your name?