Feature #3284
Fires on “,” (not labeled yet: read the examples)
- Fires on
- 0.34% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 65%
- chat 29%
- agent 4%
- python 1%
- worksheet 0%
Makes the model say
there⏎⏎ a one, camear in
Makes it not say
'reely'taveTim5Pry
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 5.13tell me a story about a boat<|user_end|><|assistant_start|>Once upon a time, there was a n
-
chat 5.04tell me a story about a ball?<|user_end|><|assistant_start|>Once upon a time, there was a unique
-
chat 5.0<|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a large
-
chat 4.98tell me a story about a tree?<|user_end|><|assistant_start|>Once upon a time, in a small town
-
chat 4.96<|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a sailor
-
chat 4.95<|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a little
-
chat 4.94<|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a girl
-
chat 4.94<|assistant_end|><|user_start|>tell me a short story<|user_end|><|assistant_start|>Once upon a time, there was a girl
-
chat 4.92<|assistant_end|><|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time, there was a l
-
chat 4.91tell me a story about a boat<|user_end|><|assistant_start|>Once upon a time, there was a n
-
chat 4.91tell me a story about a car?<|user_end|><|assistant_start|>Once upon a time, there was a little
-
chat 4.91tell me a story about a fish?<|user_end|><|assistant_start|>Once upon a time, in a big blue