Feature #862
Fires on “ the” (not labeled yet: read the examples)
- Fires on
- 2.54% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 83%
- chat 10%
- agent 5%
- worksheet 1%
- python 1%
Makes the model say
new the big little The this shiny
Makes it not say
<|arg|> earars teethbox#MIT<|assistant_start|>
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 5.15about what could be inside. So, Tim and Sue decided to open the mailbox together.⏎
-
story 4.99chest in the yard. He was very excited.⏎Max opened the chest and found
-
story 4.89smiled. She said, "Yes, Tim, you can play with the hook. But be
-
story 4.84mud puddle and ran to jump in it.⏎When Spot jumped in the mud, he heard
-
story 4.81and had many colors.⏎Tim asked his mom if they could read the unusual book together.
-
story 4.74named Lucy, came to help him. With her help, they opened the sack and found lots
-
story 4.73! Can I play with it too?"⏎Sue and Tim played with the flexible toy all day
-
story 4.71wanted to enter the tent to see what was inside.⏎Inside the tent, he met
-
story 4.64there." Sue was excited to meet the teacher.⏎They went inside the building and met the
-
story 4.62was very big and full of water. Many kids liked to play in the pool. They would
-
story 4.59Lucy ran to her mom and said, "Mom, can we open this box? I think
-
story 4.58Tim saw a big pie and said, "Mom, can we get this one?" His mom