Feature #2970
Fires on “ the” (not labeled yet: read the examples)
- Fires on
- 0.88% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 81%
- chat 10%
- agent 6%
- python 2%
- worksheet 0%
Makes the model say
ground should floor's grass back farm p
Makes it not say
<|tool_call_end|> passes⏎⏎ friendsOnce function ? eyes
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 8.92big red ball on the clear street. He
-
story 7.27a yellow ball on the floor.⏎"
-
story 7.11big shoe on his bed. It was
-
story 6.82a key. They looked around and saw a shiny metal thing on the ground. It was
-
story 6.81They lay down on the grass and watched the
-
story 6.8<|bos|>Once upon a time, there was a little girl who lived on a gloomy day. She
-
story 6.74day, a boy named Tim found sunglasses on the ground. He picked
-
story 6.69outside. He saw a big wall and wanted to see what was on the other side.⏎
-
story 6.67Sue took her big dough ball outside to show her friends. But on the way, she saw
-
chat 6.66was looking for food. He was very hungry. Spot saw something on the ground that he did
-
story 6.63on it. It was
-
chat 6.63on, they had many