Feature #1260
Fires on “ put” (not labeled yet: read the examples)
- Fires on
- 0.50% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 76%
- worksheet 12%
- chat 7%
- agent 3%
- python 2%
Makes the model say
+ in down out ` still on
Makes it not say
I," code could has<|assistant_end|>rite_*.
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.71and put it back in the
-
story 5.71and put it on her head
-
story 5.7to mail the letter. She put the letter in her
-
story 5.69Mary and you won't be so cold."⏎So Mary put her mittens on
-
chat 5.63went to the kitchen and found a big bowl. She put in all the things
-
story 5.57the bottle all day. He put the bottle on his
-
story 5.55found a big stick and put it next to her
-
story 5.46. She made a plan to remember the lime every day. She put a big green l
-
story 5.41and nodded, feeling very excited.⏎When they got home, Dad put the fuel
-
story 5.37So Jack put the net back in
-
story 5.36his birthday cake. His mom had made it for him. She had put candles and spr
-
story 5.35friends.⏎One day, Tim decided to sort his toys. He put his cars in one