Feature #4016
Fires on “ and” (not labeled yet: read the examples)
- Fires on
- 0.32% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 65%
- python 16%
- story 12%
- chat 6%
- worksheet 1%
Makes the model say
Then then SoThen howhttps:// say
Makes it not say
erked latepy<|arg|> lost mainle
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.94hole. What do you think is inside?" Sue thought for a moment and said, "Maybe
-
story 2.78not like me. What can we do?" Sue thought for a moment and said, "I
-
story 2.68him, but he is sick." Tim's mom thought for a moment and then decided to help
-
story 2.66⏎Poppy thought for a moment and had an idea.
-
story 2.56be the best swimmer in the sea." Fin thought for a moment and said, "Let
-
story 2.51is dirty now. What should we do?" Tim thought for a moment and said, "Let
-
story 2.49normal. Can you add something special?"⏎Lily thought for a moment and decided to add a
-
story 2.48older sister replied.⏎The younger sister thought for a moment and then said, "
-
story 2.45to help Bouncy.⏎Bunny thought for a moment and then said, "
-
story 2.44didn't have a toy to play with. Bob thought for a moment and then said, "
-
story 2.43know, but I want to open it." Lily thought for a moment and then suggested
-
story 2.42can we do with this cable?"⏎Sam thought for a moment and said, "Let