Feature #293
Fires on “ in” (not labeled yet: read the examples)
- Fires on
- 0.86% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 49%
- story 43%
- chat 6%
- worksheet 1%
- python 1%
Makes the model say
t different no smaller notR the time
Makes it not say
are<|arg|> pythonpythonant laughed)`. should
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.31. And they never forgot the day they found the big, shiny balloon in the tree.<|bos|>
-
story 3.16, a boy named Tom and his old dog Spot went for a walk in the park. They
-
story 3.13daddy, the king and the queen. The princess loved to play outside in the big garden.
-
story 3.1I would like that!" So the two became friends and they played together in the attic all
-
story 3.09to do things by himself. One day, Tim went to play outside in the sun.⏎
-
story 3.08day on, the star and the cloud would play together in the sky.<|bos|>
-
story 3.06his best friend, a little girl named Lily, went for a walk in the park. They
-
story 3.05Mia and Spot always played with the squirrel when they went for a walk in the forest. They
-
story 3.01they fixed the car, Mia and her mommy played with it in the room. Mia
-
story 3.01friend. From that day on, Bob and the big balloon played together in the network of
-
story 3.01boy named Tim and his reliable dog, Spot, went for a walk in the park. The
-
story 3.0Max. One day, Max decided to take a nap on a bench in the park. Suddenly