Feature #1292
Fires on “<|bos|>” (not labeled yet: read the examples)
- Fires on
- 0.69% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 29%
- story 26%
- agent 25%
- worksheet 10%
- python 10%
Makes the model say
#Bug=Once butCan ++
Makes it not say
defines<|assistant_end|>edchedize list brave adds
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 7.02played more games at the camp.<|assistant_end|><|bos|><|user_start|>Sue has
-
story 6.86they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
-
chat 6.8about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: calculator
-
story 6.8they continued to play many more games with the pieces he had bought.<|bos|>One day, a
-
story 6.79make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
-
agent 6.77crazy string. She played with her new toy all day long.<|assistant_end|><|bos|><|system_start|>tools: edit
-
chat 6.77her friends, and they all had a fun day at the park.<|bos|><|user_start|>Can you draw
-
agent 6.76had dust to play with.<|assistant_end|><|bos|><|system_start|>tools: edit
-
story 6.76know how to tell stories and add numbers.<|assistant_end|><|bos|>Anna and Lily were
-
agent 6.75great time exploring with the weird butterfly and will always remember their adventure.<|bos|><|system_start|>You are a
-
chat 6.75told all their friends about the great new land they had found.<|assistant_end|><|bos|><|system_start|>Answer with the
-
agent 6.75: be kind and help others, and they will help you too.<|bos|><|system_start|>tools: edit