Feature #1105
Fires on “ o” (not labeled yet: read the examples)
- Fires on
- 0.79% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 43%
- agent 38%
- python 12%
- chat 6%
- worksheet 1%
Makes the model say
True mxTrueulread putsed
Makes it not say
two around onehead learn<|think_start|> something down
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.58the mask again, which made his dad chuckle. He happily obliged
-
story 4.42asked, "Mom, why are you worried?"⏎"I just mentioned something
-
chat 4.26Tom worked hard to make the car feel better. He observed the
-
story 4.19don't know.⏎Sara and Tom are glad. They like to observe things
-
story 4.01pieces into the slots on the counting board. She soon figured out
-
story 3.99did! The baby was so happy with his toys, he wanted to obey mom and
-
story 3.97<|assistant_end|><|bos|>Sara and Tom like to observe things. They observe birds
-
story 3.97mom. They saw many things. Tim liked to observe everything
-
story 3.94to the underground to get groceries.⏎Jack obediently said
-
story 3.83ver her mom said to stay inside, Lizzy was sure to obey.⏎
-
story 3.83was surprised when the host announced that she would receive an even
-
story 3.8's friend, a little bird named Chirpy, came to visit. Chirpy mentioned that