Feature #941
Fires on “ each” (not labeled yet: read the examples)
- Fires on
- 0.25% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 55%
- agent 28%
- python 10%
- chat 5%
- worksheet 2%
Makes the model say
of others more and" piece length
Makes it not say
agaupperjsonellselfchttps
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 7.82and Riri were the best of friends, and they always helped each other.<|assistant_end|><|bos|>
-
story 7.71They got very mad at each other. They started to fight and push each other. The man
-
story 7.61safely. They promised to always play the right way and to help each other remember to be
-
story 7.56big tree, where they hid their toys and snacks. They trusted each other and shared everything
-
story 7.45is more important than being fat or thin. They became friends and helped each other in the kitchen
-
story 7.44problems. And from that day on, Spot and Tim always helped each other when things were
-
story 7.18on, Sam and Birdy became best friends, and they always helped each other find acorns
-
story 7.16that day on, all the animals on the farm were kind and helped each other when they needed
-
story 7.15Chirpy. From that day on, they became best friends and always helped each other.<|bos|><|system_start|>
-
story 7.05line at the same time. They both looked at each other in amazem
-
story 7.0the nuts they found. They were happy to be friends and to help each other.<|bos|>Once
-
story 6.92e and Tom. Every day, they would study together and help each other with their work