Feature #2861
Fires on “ some” (not labeled yet: read the examples)
- Fires on
- 0.43% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 42%
- story 30%
- agent 14%
- worksheet 13%
- python 1%
Makes the model say
just sorry anyone lonelydouble store swam forgive
Makes it not say
"gTheyBut Theysumesill
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.23!<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
-
chat 3.05Hey<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
-
chat 3.04Hello<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
-
chat 3.03Hi<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
-
chat 3.01there<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
-
chat 2.96!<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
-
chat 2.94!<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
-
chat 2.91!<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
-
chat 2.91i<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
-
chat 2.9!<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
-
chat 2.88Hey<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
-
chat 2.88Sure! Hi there! Would you like a story, or some numbers to add?