Feature #1225
Fires on “ and” (not labeled yet: read the examples)
- Fires on
- 0.73% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 86%
- chat 9%
- worksheet 2%
- agent 2%
- python 1%
Makes the model say
they said count asked when saw Let,
Makes it not say
<|assistant_end|> myprint<|user_end|>Her<|assistant_start|>His =
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 5.05went to the kitchen and found a big bowl
-
story 4.86she went to the stove and started to play.
-
story 4.76Tim. Max wanted to find out, so he went to the door and barked. Tim said
-
story 4.73she was a baby.⏎She went to the living room and saw her brother Tom
-
story 4.68tree and wanted to get a closer look. He ran to the tree and started to climb.
-
story 4.65pool and was struggling in the water. Mia quickly ran outside and called out to Tom
-
story 4.6could buy something to eat with it.⏎He went to the store and asked for some food
-
story 4.57sea. Every day, Bob would go outside and raise his hands to
-
story 4.44a fun place to play!" So, he ran to the patch and found his friend,
-
story 4.43He wanted to play with his car.⏎Tim went to the kitchen and saw his mom.
-
story 4.39replace the ball with a new one.⏎Max ran to the store and found a new red
-
story 4.39and wanted to see what was under it. He ran to the tree and found a little bird