Feature #2230
Fires on “,” (not labeled yet: read the examples)
- Fires on
- 0.55% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 81%
- agent 9%
- chat 8%
- worksheet 1%
- python 1%
Makes the model say
I you we let can look why who
Makes it not say
typo seek!")[::ultipl<|assistant_start|>g shouted
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 11.32The fairy said, "Tim, you have been selfish
-
story 11.25had an idea. She said, "Max, let's go to
-
story 10.94talking to him about it. She said to him, "Johnny, you are gifted
-
chat 10.8best friend, a squirrel named Sam.⏎Sam said, "Ben, let's play a
-
story 10.71play with. Bob thought for a moment and then said, "Sam, let's share my
-
chat 10.01Tim saw his friend, Sue. Sue said, "Tim, do you want to
-
story 9.89es.⏎The truck man got out and said, "Buddy, I have a box
-
story 9.84squirrel, came to help. Sam said, "Ben, we need to move
-
chat 9.71.⏎Tim saw his friend, Sue. Sue said, "Tim, do you want to
-
story 9.68Tim's mom saw him looking at the bug and said, "Tim, don't touch that
-
story 9.68, he said, "Sally, look at my impress
-
story 9.67he decided to share it with Lily.⏎Tom said, "Lily, let's share my