Feature #1830
Fires on “ the” (not labeled yet: read the examples)
- Fires on
- 0.18% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 44%
- chat 22%
- agent 20%
- python 14%
- worksheet 0%
Makes the model say
house ball world town told family day ch
Makes it not say
<|arg|>calculator functions %<|tool_call_start|> downFixed
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.7. There were games, yummy food, and happy music. Everyone in the town loved the festival
-
story 2.46village, there was a fun race every year. All the people in the village liked the race
-
story 2.45liday.⏎On the holiday, everyone in the town came together.
-
story 2.43was an unusual tunnel. It was big and long. Everyone in the town liked to
-
story 2.38day. The sunflower became the biggest and tallest one in the whole town.⏎One
-
story 2.37Wow, Tim! Your hands look like a rainbow!" Everyone in the room laughed. Tim
-
story 2.36things from junk, and they became the most popular kids in the town.<|bos|>If
-
story 2.33idea. She wanted to plan a special surprise for all the people in her village. She asked
-
story 2.25was very fast. It could make things very quick. People from the town loved the m
-
story 2.21shared his toys, and used his manners. And everyone in the calm little town lived
-
chat 2.17She was so happy and pleased with her work. Everyone in the kingdom was
-
story 2.15make a request. He wanted to be the strongest bear in the forest.⏎The