Feature #3766
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 1.40% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 83%
- chat 15%
- agent 1%
- python 1%
- worksheet 0%
Makes the model say
new big small little many returns realprint
Makes it not say
<|assistant_end|>Run.akes rain awayide Every
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 6.59sun. While he was hopping, he saw a strange object
-
story 6.5new things together. As they walked, they saw a big, pretty sun
-
chat 6.42the water. One day, while he was diving, he saw a big, black rock
-
story 6.1there. Then, she saw a little boy named Tim
-
chat 6.07he saw a big ball. He
-
story 6.07One day, he found a bulb in
-
chat 6.07, the pink witch saw a little bird. The
-
story 5.92from the storm. But then, they saw a sign that said,
-
story 5.92would roll and jump in it all day. One day, Tom saw a big dog named Max
-
story 5.91to play with his friends in the park. One day, Buddy saw a big ball near the
-
story 5.89, a mighty big cat named Tom went for a walk. He saw a little dog named Tim
-
story 5.88. One day, she found a weird, round toy