Feature #1695
Fires on “ of” (not labeled yet: read the examples)
- Fires on
- 2.33% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 84%
- chat 9%
- agent 4%
- worksheet 2%
- python 1%
Makes the model say
toys things new food toy special pretty yummy
Makes it not say
named([elappy farmer<|tool_start|> '")`
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 8.51ed while his neighbor opened the case and showed him all the amazing things inside.
-
chat 6.53dust in it! The truck driver saw Tim and gave him all the dust. Tim
-
story 6.41food is gone!"⏎Tim had an idea. "Let's mix some new spicy food!"
-
story 6.24there lived a dangerous zoo. The zoo was home to all sorts of wild animals, from
-
story 6.19Tim. Tim had a toy box that he loved to fill with all his toys. One day
-
story 5.89.⏎Next, she packed lots of clothes. They were
-
story 5.79and his friends decided to play a game. They wanted to count all the pretty flowers in the
-
story 5.79453<|assistant_end|><|bos|>Mommy had a big pan and she mixed up some eggs. She c
-
story 5.72and explained to Sally that the refrigerator was a special kind of box full of food. She said
-
story 5.68a musician came to visit the preschool. He had all sorts of interesting instrum
-
story 5.64and Lily like to play in the park. They have a big basket of apples. They want
-
story 5.63extra, leave some."⏎Soon, people started to share their bread with each other