Feature #44
Fires on “ her” (not labeled yet: read the examples)
- Fires on
- 1.72% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 72%
- chat 14%
- agent 10%
- python 3%
- worksheet 2%
Makes the model say
park so play the yard room garden forest
Makes it not say
new<|think_end|>]`en noisestwiceRenameddouble
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.9.<|bos|>One day, a little girl named Lily went to play in her yard. Lily saw
-
story 4.87tree.<|bos|>One day, a little boy named Tim was playing in his room. He was
-
story 4.55?<|assistant_end|><|bos|>One day, a little girl named Mia was playing in her room. She had
-
story 4.51<|bos|>One day, a little girl named Sue found a rake in her yard. It was
-
story 4.5.<|assistant_end|><|bos|>One day, a little girl named Lucy was playing in her room. She was
-
story 4.49happy.<|assistant_end|><|bos|>One day, a boy named Tim was playing in his yard. He liked
-
story 4.48they could not find it.⏎Later that day, grandma came into the room with a big
-
story 4.45`.⏎<|bos|>One day, a little girl named Lily was playing in her room. She heard
-
story 4.436.<|bos|>One day, a girl named Lily was playing in her room. She wanted
-
story 4.38.<|assistant_end|><|bos|>One day, a little girl named Mia was playing in her room. She was
-
chat 4.28<|user_end|><|assistant_start|>One day, a big dog named Max went to sleep in his bed.<|assistant_end|><|bos|>
-
story 4.27.<|assistant_end|><|bos|>One day, a little girl named Amy was playing in her room. She had