Feature #602
Fires on “ each” (not labeled yet: read the examples)
- Fires on
- 0.02% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 47%
- agent 36%
- python 8%
- chat 7%
- worksheet 2%
Makes the model say
`,ented other0 This very
Makes it not say
+") `<|assistant_start|>ice+HelloThank
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 1.15a new game. We have to remain in a line and follow each other. I will
-
story 1.13ps. You have to be careful and tidy when you paint. That is how you show your
-
story 1.12said, "Of course, you can. I have an idea. Why don't you help
-
story 1.1the new lab! They were happy to be free and see the world. They played and
-
story 1.06sack. One day, he went for a walk in the park
-
story 1.04and went back to her dictionary. She looked at the word "bitter" again
-
story 0.99Then, mom came into the living room. She heard the noises and saw Lily and Ben
-
story 0.97tell me a joke?"⏎Jack chuckled and said, "Why did the chicken z
-
story 0.91"You're welcome, Mia. I'm proud of you for learning something new."<|bos|>
-
agent 0.91hlaf(7))⏎ ^^^^⏎NameError: name 'hlaf' is not
-
story 0.91chest opened and they saw lots of pretty things inside. There were toys, balls, and
-
story 0.88, their mom came home and saw the cooler in the backyard. She opened it and saw