Feature #578
Fires on “ were” (not labeled yet: read the examples)
- Fires on
- 0.53% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 56%
- agent 34%
- chat 7%
- python 2%
- worksheet 0%
Makes the model say
lot toys many room toy loved shiny table
Makes it not say
<|assistant_end|> ==ningAddedpythonCreate create The
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.33the top. Finally, the box opened. Inside the box, there were many colorful balls.
-
story 4.83She pushed the door and it opened easy. Inside the tower, there were many stairs.
-
story 4.75went closer to the box and looked inside. Inside the box, there were many colorful balls.
-
story 4.58's home, the girl opened the box. Inside the box, there were many mild birds
-
story 4.44box under the tree. She opened it and saw treasure inside. There were pretty stones and
-
story 4.4the chest opened and they saw lots of pretty things inside. There were toys, balls,
-
story 4.15The cat came back with a big bag. Inside the bag, there were many toys for the
-
chat 4.15very curious. He opened the box and found a treasure inside! There were shiny coins and pretty
-
story 4.13a big drawer in her room. Inside the drawer, there were many toys. Lily
-
story 4.12and Tom were so happy. But, when they looked inside, there were no muffins
-
story 4.12kitchen, there was a drawer. Inside the drawer, there were many friends. There
-
story 4.11, there was a big garage. Inside the garage, there were many things to play