Feature #1339
Fires on “ was” (not labeled yet: read the examples)
- Fires on
- 0.87% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 59%
- story 27%
- python 9%
- chat 5%
- worksheet 1%
Makes the model say
outsidelloingight coming aboutpattern door
Makes it not say
next? He areny each is pain
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.01But then, something unexpected happened. The fire was not real. It
-
story 2.72scared anymore. They laughed and played with the bird. The unexpected twist was that the bird was
-
story 2.68together with the ball, and they were very happy. The unexpected thing was that Max, the
-
story 2.52But one Tuesday, something unexpected happened. The sun was gone, and it
-
story 2.48cut the cake, something unexpected happened. The cake was full of toys!
-
story 2.33when they all went inside to look around, they saw the leak was still there.⏎
-
chat 2.31at the joke.⏎But then, something unexpected happened. The fire was not real. It
-
story 2.25.⏎The hurricane was very loud and it
-
chat 2.24. They laughed and watched as the frog hopped away. The leak was fixed, and Tom
-
chat 2.23at the joke.⏎But then, something unexpected happened. The fire was not real. It
-
story 2.17wind was not so bad after
-
story 2.16was so happy. The yellow dog was his new friend. The surprise was the best.<|bos|>