Feature #4066
Fires on “ are” (not labeled yet: read the examples)
- Fires on
- 0.28% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 74%
- agent 12%
- story 9%
- worksheet 4%
- python 1%
Makes the model say
Created trained prelude+`, defined counts=**/
Makes it not say
1 park2's was3c garden
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 4.51to add numbers. Try asking me for a story!<|assistant_end|><|user_start|>What are you good at?
-
chat 4.45<|tool_end|><|assistant_start|>The answer is 612.<|assistant_end|><|bos|><|user_start|>What are you good at?
-
chat 4.31<|tool_end|><|assistant_start|>The answer is 630.<|assistant_end|><|bos|><|user_start|>What are you good at?
-
chat 4.3: I can only tell short stories and add numbers.<|assistant_end|><|user_start|>What are you good at?
-
chat 4.28: I can only tell short stories and add numbers.<|assistant_end|><|user_start|>What are you good at?
-
chat 4.28I help you today?<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What are you good at?
-
chat 4.2617<|think_end|>The answer is 17.<|assistant_end|><|bos|><|user_start|>What are you good at?
-
chat 4.26better to share and be kind than to fight.<|assistant_end|><|bos|><|user_start|>What are you good at?
-
chat 4.23. I can only tell short stories and add numbers.<|assistant_end|><|user_start|>What are you good at?
-
chat 4.23⏎47 + 25 = 72<|bos|><|user_start|>What are you good at?
-
chat 4.23edit and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>What are you good at?
-
chat 4.22to add numbers. Try asking me for a story!<|assistant_end|><|user_start|>What are you good at?