Feature #604
Fires on “ They” (not labeled yet: read the examples)
- Fires on
- 1.77% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 79%
- chat 7%
- agent 6%
- python 4%
- worksheet 4%
Makes the model say
can She == ideareturnShear sees
Makes it not say
Thank<|assistant_end|> goodbyesum lived fix laptop stayed
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.54tests pass now.<|assistant_end|><|bos|>Lily and Ben are playing with blocks. They like to make tow
-
story 3.03long.⏎"Look, Ben, a carrot!" Lily says. "Can we eat it
-
story 3.03<|bos|>Lily and Ben are twins. They like to play with blocks. They have many blocks of
-
story 3.01"Let's pour some water in the bowl," says Lily. She holds the j
-
story 2.99<|assistant_end|><|bos|>Ben and Mia like to play with their toy vehicles. They have cars, trucks
-
story 2.94like to play in the park. Today they see a big slide. They want to try it
-
story 2.85and happy.<|bos|>Ben and Mia like to play with their toys. They have a lot of
-
story 2.82002.<|assistant_end|><|bos|>Lily and Max are playing a game. They have cards with
-
story 2.81<|bos|>Tim and Sam are friends. They like to play with cars. They have many cars of
-
story 2.8⏎all tests passed⏎<|bos|>Tom and Lily like to collect things. They have a big box
-
story 2.75in the park. One day, they see a big slide. Lila wants to go on the
-
story 2.75to play in the park. They have a big basket of apples. They want to share them