Feature #3498
Fires on “ mom” (not labeled yet: read the examples)
- Fires on
- 0.39% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 72%
- agent 13%
- chat 10%
- python 2%
- worksheet 2%
Makes the model say
. next came momb said7 drew
Makes it not say
PythonupperMITmd togethertxt many named
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.65, a little girl named Lily went to the airport with her mom and dad. They
-
chat 2.62a time, a little girl named Lucy went to the park with her mom.<|assistant_end|><|bos|>Once
-
story 2.62.⏎One day, Tim found a big, old box in his room. It looked very
-
story 2.62One day, a young boy named Tim went to the store with his mom. They needed to
-
story 2.61. One day, she went to the ice-cream shop with her mom.⏎At the
-
story 2.61One day, a little boy named Tim went to the park with his mom. They saw a
-
story 2.6One day, a little boy named Tim went to the park with his mom. Tim saw a
-
story 2.59, a little girl named Lucy found a thick cardboard box in her room. She did not
-
chat 2.58nday, a little boy named Tim went to the park with his mom.<|assistant_end|><|bos|>One
-
story 2.58all day.⏎One day, Tim found a crazy book in his room. The book was
-
story 2.57<|bos|>One day, a boy named Tim went to the store with his mom. They wanted to
-
story 2.57every day. One day, Tim found a big screen in his house. He was very