Feature #2720
Fires on “ to” (not labeled yet: read the examples)
- Fires on
- 1.55% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 70%
- chat 18%
- agent 6%
- python 4%
- worksheet 1%
Makes the model say
. wanted heard a race outside together met
Makes it not say
:`])(" equalsst "!"()`MIT
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.72.<|assistant_end|><|bos|>One sunny day, a little girl named Mia was eager to go to the g
-
story 2.69day, a boy and a girl went to play outside. They wanted to see who could wake
-
story 2.53the rabbits.⏎One sunny day, Bobo and his friends decided to play a game.
-
chat 2.48the sea!<|user_end|><|assistant_start|>One day, a funny fish named Bob wanted to swim in the deep
-
story 2.46to play hide and seek with her friends. One day, they decided to play in the park
-
story 2.43play outside with his friends. One day, Tom and his friends decided to go to a camp
-
story 2.43play with me?" Bop smiled and said, "Yes, let's play together!"⏎
-
chat 2.43The adventurous shrimp was excited and said, "Yes, let's play!"⏎As
-
chat 2.41a kind cat named Kitty felt a strong urge to go outside and play. The sun
-
chat 2.39a bunny!<|user_end|><|assistant_start|>One day, a large bunny named Bob wanted to hop to the store
-
chat 2.38a story!<|user_end|><|assistant_start|>One day, a happy fish named Fin wanted to raise a big rock
-
chat 2.38a time...<|user_end|><|assistant_start|>One day, a dog named Spot wanted to play. He went