Feature #3576
Fires on “<|bos|>” (not labeled yet: read the examples)
- Fires on
- 0.66% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 29%
- story 26%
- agent 25%
- python 10%
- worksheet 10%
Makes the model say
itemall` name numbersovekehing
Makes it not say
]) too returns betteri so on So
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 14.02they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
-
agent 13.94that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
-
story 13.9make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
-
chat 13.88that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>Who made you
-
agent 13.85that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
-
story 13.85about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|>Lila and Sam were
-
agent 13.83that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
-
worksheet 13.83that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Lily has 3
-
agent 13.82tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
-
worksheet 13.8Would you like a story, or some numbers to add?<|assistant_end|><|bos|>Compute 26
-
agent 13.79about that. I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
-
agent 13.79that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit