Feature #3945
Fires on “<|bos|>” (not labeled yet: read the examples)
- Fires on
- 0.87% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 29%
- story 26%
- agent 26%
- worksheet 10%
- python 10%
Makes the model say
! ever```3, everyoneOnceI
Makes it not say
his_*. saidscript He They idea
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 9.53another, there will be fewer disagreements.<|bos|><|system_start|>tools: calculator
-
story 9.34make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
-
chat 9.31work together, you can learn and have fun at the same time.<|bos|><|user_start|>Tell me a
-
python 9.28always ask for help when you need it, and never give up.<|bos|>Bug: `min
-
story 9.21magic, and Lily's wish made the party the best one ever.<|bos|>The engine was loud
-
python 9.21the Python files in this project.<|assistant_end|><|bos|># app.py
-
python 9.2others can make a place even more special, and bring you joy.<|bos|># app.py
-
story 9.19they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
-
python 9.19is that sharing with others brings happiness and peace to everyone.<|bos|>Bug: `doubled
-
story 9.17together and listen to our friends, we can overcome any problem.<|bos|>Once upon a time
-
chat 9.16played more games at the camp.<|assistant_end|><|bos|><|user_start|>Sue has
-
agent 9.15it's better to share and be together than to be separate.<|bos|><|system_start|>tools: edit