Feature #1728
Fires on “ the” (not labeled yet: read the examples)
- Fires on
- 0.09% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 53%
- worksheet 25%
- chat 15%
- python 4%
- agent 2%
Makes the model say
0 sun41red hug3 t
Makes it not say
<|assistant_end|>de<|tool_end|>expressionopencodevowels<|think_end|> i
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.31little girl named Lucy went for a walk. The sun was shining and the weather was m
-
chat 3.11went to the park with her parent. The sun was bright and the sky was blue.
-
story 3.01. She was no longer so lazy!<|bos|>The sun was shining and the birds were singing.
-
story 3.0in the park. He was very glad. The sun was warm and the sky was blue.
-
chat 2.96for a walk in the park. The sun was shining, and the birds were singing.
-
story 2.95to walk because it was easy and fun. The sun was shining and the birds were singing.
-
chat 2.95went for a wander in the park. The sun was shining and the birds were singing.
-
story 2.91and throw it high in the sky. The sun was shining, and the birds were singing.
-
story 2.83went to the park with her mom. The sun was shining, and the light was bright.
-
chat 2.79went to the park with her parent. The sun was bright and the sky was blue.
-
story 2.77biggest shells to show his mom and dad. The sun was shining and the birds were singing.
-
story 2.76put on his helmet and went outside. The sun was shining, and the birds were singing.