Feature #1256
Fires on “ eat” (not labeled yet: read the examples)
- Fires on
- 1.12% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 79%
- chat 14%
- agent 4%
- python 3%
- worksheet 1%
Makes the model say
rest lunch water fromBut wantcoOnce
Makes it not say
them goodbye They<|think_start|> theyThey starslab
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.99cold out here, why don't you come inside my house and have some hot chocolate?" Sammy
-
story 3.81to eat. He asked Jack
-
story 3.68at his mom and instantly ran to find a spot to eat his ice cream.
-
story 3.64tired. He let out a big yawn and decided to take a nap. He found
-
story 3.56a while, they got tired. Tom said, "Let's take a nap under the big
-
story 3.5680<|assistant_end|><|bos|>It was a cold day and Lily wanted to drink some cocoa.
-
story 3.48⏎After playing for a while, Tim and his mom sat down to eat lunch. They had
-
story 3.46day, as he was walking through a field, he stopped to take a rest. He lay
-
story 3.45. The pie smelled great.⏎Lucy and her mom sat down to eat the pie. They
-
story 3.44big scare. They went to the nearby pond and took a long drink of water. After that
-
story 3.43after playing for a long time. They sat down on a bench to eat their lunch. Lily
-
story 3.42, so it stopped running.⏎The cow reached the hay and ate happily. The horse