Feature #3718
Fires on “ of” (not labeled yet: read the examples)
- Fires on
- 0.48% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 70%
- agent 11%
- python 9%
- chat 7%
- worksheet 2%
Makes the model say
r subtract work sp ever this take squirrel
Makes it not say
Renamed<|think_end|> saw are kitchen heard text room
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.05taking turns and being fair with each other. And they became the best of friends.<|bos|>One
-
story 3.04From that day on, the baby and Mr. Bear became the best of friends. They played
-
story 3.03sat in their nest and talked about their day. They were the best of friends.<|bos|><|system_start|>
-
story 3.01cat and the dog always helped each other, and they became the best of friends.<|bos|>One
-
story 3.0They played with their new ball every day, and they became the best of friends. And that
-
story 2.99day together. From that day on, Tom and Tim became the best of friends, all because
-
story 2.98. And from that day on, Tim and the girl became the best of friends.<|bos|>Tom
-
story 2.95boy, Brian, who loved to learn. Every day he would sit in his chair
-
chat 2.95. From that day on, Bobo and Riri were the best of friends, and they
-
story 2.93jog and do yoga together every day. They became the best of friends.<|bos|>#
-
story 2.87little money, but his heart was full of joy. Every morning he would insist on walking
-
story 2.86friends. She was not selfish anymore. Lily and Tim became the best of friends, and they