Feature #1874
Fires on “ at” (not labeled yet: read the examples)
- Fires on
- 0.45% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 72%
- chat 13%
- agent 10%
- python 4%
- worksheet 1%
Makes the model say
firstdemolists files last sunde*
Makes it not say
.8 and9 of there to<|bos|>
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.11named Sue. Sue loved to play at the park. Her favorite thing at the park was the
-
story 5.06Fluffy went to a big party. There was a lot of delicious food at the party. Sue
-
story 4.85her mom was watching a film. She liked the film because it had attractive colors and
-
story 4.81's mom had a surprise for him. She had found a yellow car at a different store!
-
story 4.76Lily could not wait to tell her grandma about the magic bird she met at the airport
-
story 4.65. But then, something unexpected happened. The bird was not a bird at all! It was
-
story 4.65was gone. Sue felt even more sad because now she had no bird at all.<|bos|><|system_start|>
-
story 4.65aisy didn't understand what Daddy meant at first. But then
-
story 4.61loved yogurt very much, especially the one with fruit at the bottom.⏎
-
story 4.6herself. It was bitter and yucky. Lily did not like it at all.⏎Later
-
story 4.56and gave it a hug. The kitten was not scary at all. Sue took
-
story 4.5dad and they both laughed.⏎The flexible lip was not scary at all, it was