Feature #2008
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.75% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 51%
- agent 35%
- chat 9%
- worksheet 3%
- python 2%
Makes the model say
wind w we s<|bos|> sure cr
Makes it not say
`.() *1c arsoh
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.92started to cry. But suddenly, from above, she felt a warm breeze and
-
story 2.89grass, wishing for someone to talk to.⏎One day, a little girl named Lily
-
story 2.86could not lift it up.⏎Then, a spicy smell appeared.
-
story 2.85to give up the microphone.⏎Just then, a wise old man came up
-
story 2.78He did not notice that Sam was crying.⏎Suddenly, a loud noise made Ben turn
-
story 2.78heavy that Jan was not able to pick it up.⏎A wise old man who was
-
story 2.77not find it. Tom and Sue were very sad.⏎Then, a big wave came and
-
story 2.75it just couldn't peck at it.⏎Just then, a small child sprang up
-
story 2.7think and help his friends when they were lost.⏎One day, a small squirrel came to
-
story 2.68in the village were not happy with them.⏎One day, a wise old man came to
-
story 2.68friend. Tim and the bee were sad.⏎Just then, a big wind came and blew
-
story 2.62. Pippin was happy to eat and rest.⏎But then, a big bird came and