Feature #2922
Fires on “ forgot” (not labeled yet: read the examples)
- Fires on
- 0.35% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 69%
- chat 18%
- agent 9%
- worksheet 2%
- python 1%
Makes the model say
EADMEexpressionoldString defines equals<|think_start|>dou<|assistant_start|>
Makes it not say
a c and b closer end "<|bos|>
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.6."⏎He got up and followed his mom to the kitchen. He forgot about the clock and
-
chat 3.49behind the couch.⏎By the end of the day, everyone forgot about the kitten.
-
story 3.43She said goodbye to her friends and started to walk away. But she forgot her little mirror on
-
story 3.3played with the ball. They laughed and had a good time. Tommy forgot about his bricks
-
story 3.26nodded and they went inside the house. They ate yummy food and Tim forgot all about the ghost
-
story 3.2table. Sue was so excited to eat the soup. But, she forgot to be careful.
-
story 3.16Lily and stayed by her side. They continued their walk, and Max forgot about the cat.
-
story 3.08and licked Anna's face. Anna laughed and hugged the dog. She forgot about her baby doll
-
story 3.04with the toy soldier together. And for a little while, they forgot about the war and
-
story 3.03played in the snow all day. They had so much fun that Tim forgot about the door.
-
story 3.03boy and dog.⏎Tom and Spot felt happy and cozy. They forgot about the lightning
-
story 3.01quack!" the penguin nodded.⏎Anna and Ben smiled. They forgot about their snow war