Feature #3280
Fires on “ much” (not labeled yet: read the examples)
- Fires on
- 0.30% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 60%
- chat 20%
- worksheet 11%
- python 5%
- agent 4%
Makes the model say
fun careful better about He money,!
Makes it not say
't],en treesHello its found saw
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 7.65to be careful and watch for trouble when they played.<|bos|><|user_start|>How much is 83
-
chat 7.57The sun was bright and the sky was blue.<|assistant_end|><|user_start|>How much is 1 +
-
story 7.54omps. Lily clapped and cheered for him. They were having so much fun.⏎But
-
chat 7.5stop smiling!<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>How much is 12
-
chat 7.42a small and friendly assistant.<|system_end|><|user_start|>How much is 99
-
chat 7.39all lived happily ever after.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>How much is 2 +
-
story 7.34and ran away to join the others in the game. They had so much fun in the sunny
-
chat 7.27tools: calculator<|system_end|><|system_start|>Do not use the calculator.<|system_end|><|user_start|>How much is 10
-
worksheet 7.229.<|assistant_end|><|bos|>How much is 40
-
worksheet 7.19on the tree. And they all lived happily ever after.<|bos|>How much is 99
-
chat 7.17026<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>How much is 3 +
-
chat 7.16today?<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>How much is 20