Feature #3033
Fires on “How” (not labeled yet: read the examples)
- Fires on
- 0.28% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 48%
- agent 20%
- worksheet 16%
- story 15%
- python 2%
Makes the model say
m cane[ will`.Canob
Makes it not say
find day⏎ last wrong nextTim in
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 5.84and add numbers, step by step or with a calculator.<|assistant_end|><|user_start|>How can you help me
-
worksheet 5.29. I only know how to tell stories and add numbers.<|assistant_end|><|bos|>How much is 5
-
chat 5.25add numbers, step by step or with a calculator.<|assistant_end|><|bos|><|user_start|>How do I learn F
-
story 5.21, but it was too hard.⏎The girl asked, "How can I unlock the
-
chat 5.13't stop smiling!<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>How much is 1
-
chat 5.0712<|think_end|>The answer is 12.<|assistant_end|><|bos|><|user_start|>How much is 5
-
worksheet 5.079.<|assistant_end|><|bos|>How much is 4
-
chat 5.05a small and friendly assistant.<|system_end|><|user_start|>How much is 9
-
chat 5.04. I only know how to tell stories and add numbers.<|assistant_end|><|user_start|>How can you help me
-
chat 5.0230<|think_end|>The answer is 30.<|assistant_end|><|bos|><|user_start|>How can you help me
-
chat 4.9901.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>How much is 7
-
worksheet 4.9979 and 21 is 3300.<|bos|>How much is 3