Feature #3417
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.81% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 42%
- agent 26%
- chat 24%
- python 6%
- worksheet 1%
Makes the model say
is way lotchtxselfom
Makes it not say
plus For. and, for: friends
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 6.32He gave the cat some juice to drink. The cat liked the juice a lot. Tim and
-
story 5.95They learned that sometimes, something scary can help you when you need it the most.<|bos|><|system_start|>
-
story 5.9552.<|assistant_end|><|bos|>Lily was a green bird who liked to talk a lot. She talked
-
story 5.79anymore. She liked the toy a lot.⏎But
-
chat 5.45All the kids came to look at the cake. They liked the cake a lot. They ate
-
story 5.44when she was sad, and when she was bored. She danced all the time.⏎One
-
story 5.42They all knew that Tim could not really fly, but they loved him anyway. From that
-
story 5.23was a fat cat. It was called Fluffy and it liked to sleep a lot. It would
-
story 5.2that the circle made.⏎Alice loved making circles come alive with her
-
story 5.09who helped a lost boy find his way home. Tim liked the story a lot.⏎When
-
story 4.81y and dark. But Sally was determined to enjoy it anyway. She skipped
-
chat 4.78bedtime, Kitty tried to remember the stories her mom told her.