Feature #1157
Fires on “ the” (not labeled yet: read the examples)
- Fires on
- 0.80% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 67%
- chat 17%
- worksheet 7%
- agent 6%
- python 3%
Makes the model say
big sun wind after grass soft tests leaves
Makes it not say
<|arg|>⏎<|tool_end|>py<|assistant_end|>expression. Inside
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.76walking through the forest when she noticed
-
story 5.71Mom and Dad. They liked to play in the sand and splash in the water. They saw
-
story 5.68mom and dad. They liked to play in the sand and splash in the water. They saw
-
story 5.47small dog named Tim went for a walk. He liked to walk in the park. He was
-
story 5.260<|assistant_end|><|bos|>Lily and Ben are friends. They like to play in the garden. They see
-
story 5.26outside and march around her backyard under the bright sun. She
-
story 5.24around in the air.⏎"
-
story 5.2was a small cat named Tom. Tom liked to run and play in the dust. He
-
story 5.17<|assistant_end|><|bos|>Lila and Sam were best friends. They liked to play in the park every day.
-
story 5.12}⏎<|bos|>Lila and Ben are friends. They like to play in the park. One day
-
story 5.1letter(s)`.<|assistant_end|><|bos|>Tim and Liz liked to play in the attic. They
-
story 5.08<|assistant_end|><|bos|>Lily loved to dance. She danced in her room, in the garden, and in