Feature #2370
Fires on “ the” (not labeled yet: read the examples)
- Fires on
- 0.37% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 63%
- python 16%
- agent 11%
- chat 7%
- worksheet 3%
Makes the model say
and. green sts of little
Makes it not say
<|user_start|>https<|user_end|>emo`. typo examplepped
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 1.6a beautiful view of the fields, the trees, and the sky. They also
-
story 1.48She ran to the stage. She saw the lights and the music. She saw the
-
story 1.48I hope so." She tucked Sara in and turned off the light. She left the
-
story 1.47looked at all the things in the park. He saw the birds and the trees and the funny
-
story 1.45is gone!"⏎They saw the carrot nose, the hat, and the scarf on
-
story 1.45to the tournament and found plenty of mighty steel pieces that he bought
-
python 1.44⏎```⏎⏎`is_even` returns True if x is even. For example,
-
story 1.42. Zip had many friends, and they all liked his fashion.⏎One day
-
story 1.4outside and raise his hands to the sky. He liked to feel the rain on his metal
-
story 1.38. The cat was so excited! It started to whisper to the rice, telling it
-
story 1.38Let's go say hello!" Ben said.⏎They put down their snowballs and ran
-
story 1.38goes to bed. She sings songs she knows and songs she makes up.⏎One day