Feature #3891
Fires on “,” (not labeled yet: read the examples)
- Fires on
- 0.86% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 67%
- python 13%
- agent 10%
- chat 8%
- worksheet 3%
Makes the model say
went they go walked walk swim he agreed
Makes it not say
plusfrom away Suddenly homeatterhing hiding
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.79little boy named Tim. He lived in a small house with his mom, dad, and his
-
story 2.6, but he wanted to get his ball. So, he thought of a
-
story 2.55doubled.<|assistant_end|><|bos|>Tom and Lily went to the beach with their mom and dad. They liked
-
story 2.47near the big tree, a little girl named Lily lived with her mom and dad. One day
-
chat 2.43a distant house and wanted to go there. He asked his mom, "Can I go
-
story 2.39little boy named Tim. Tim lived in a small house with his mom, dad, and dog
-
story 2.34house. A little girl named Sally lived in the house with her mom and dad. Sally was
-
chat 2.3a fair princess. She lived in a big castle with her mom and dad. The princess
-
story 2.28was a small princess. She lived in a big castle with her mom and dad. The small
-
story 2.28kind. He wanted to help the bird. So, the cat and the
-
story 2.28normal boy named Tom. He lived in a small house with his mom and dad. Tom had
-
story 2.26lived in a big castle with his mom, the queen. P