Feature #3838
Fires on “<|bos|>” (not labeled yet: read the examples)
- Fires on
- 0.91% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 36%
- story 36%
- agent 17%
- worksheet 6%
- python 6%
Makes the model say
For So⏎ long mainl B H
Makes it not say
moralIC NowNowincludes knew my unexpected
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 4.08Would you like a story, or some numbers to add?<|assistant_end|><|bos|>If you add
-
story 3.94there<|user_end|><|assistant_start|>Hi! How can I help with your code?<|assistant_end|><|bos|>One day, Tim
-
agent 3.94Hello!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|><|system_start|>tools: edit
-
agent 3.94Would you like a story, or some numbers to add?<|assistant_end|><|bos|><|system_start|>tools: edit
-
agent 3.92<|system_end|><|user_start|>Thanks!<|user_end|><|assistant_start|>Sure! You're welcome!<|assistant_end|><|bos|><|system_start|>tools: edit
-
worksheet 3.89Would you like a story, or some numbers to add?<|assistant_end|><|bos|>The sum of
-
chat 3.88children and add numbers, step by step or with a calculator.<|assistant_end|><|bos|><|system_start|>tools: calculator
-
chat 3.87Would you like a story, or some numbers to add?<|assistant_end|><|bos|><|system_start|>Answer with the
-
agent 3.82<|assistant_start|>Sure! Hello! How can I help you today?<|assistant_end|><|bos|><|system_start|>tools: edit
-
python 3.8Would you like a story, or some numbers to add?<|assistant_end|><|bos|>```python⏎def
-
story 3.77Would you like a story, or some numbers to add?<|assistant_end|><|bos|>Once upon a time
-
chat 3.76<|system_end|><|user_start|>Thank you<|user_end|><|assistant_start|>Sure! You're welcome!<|assistant_end|><|bos|><|system_start|>tools: calculator