Feature #1645
Fires on “ each” (not labeled yet: read the examples)
- Fires on
- 0.26% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 68%
- agent 24%
- chat 8%
- worksheet 1%
- python 1%
Makes the model say
one([ is time trying nice corner friend
Makes it not say
thletter %config<|system_end|>Thank`to
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.62letely surrounded, and John and Jane hugged each other. John whis
-
story 3.59people inside.⏎While they were waiting, Lucy saw a boy sitting next to her. He
-
story 3.58that he could help his mom and dad talk to each other. From that
-
story 3.55big tree, where they hid their toys and snacks. They trusted each other and shared everything
-
story 3.52the nuts they found. They were happy to be friends and to help each other.<|bos|>Once
-
story 3.5played with her friends. They ran, jumped, and called to each other. They had
-
story 3.48is more important than being fat or thin. They became friends and helped each other in the kitchen
-
story 3.4740<|bos|>Tom and Mia were best friends. They lived next to each other and played every
-
chat 3.43and Riri were the best of friends, and they always helped each other.<|assistant_end|><|bos|>
-
story 3.41bag of snacks! Spot and his friends ate their snacks and shared with each other. They were
-
story 3.41that day on, all the animals on the farm were kind and helped each other when they needed
-
story 3.36. The squirrel and the bird became best friends. They played and helped each other every day,