Feature #1580
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 1.51% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 77%
- chat 12%
- agent 10%
- python 1%
- worksheet 1%
Makes the model say
big new good great special lot very fun
Makes it not say
has list characters prints_*. edit passes.
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 8.55Tuna had a special gift.<|assistant_end|>
-
story 7.61had a lot of fun with
-
chat 7.6was blue and had a thick shirt. He
-
story 7.6. Tornado had a big yard to play
-
story 7.55for the person she was meant to help. That night she had a dream about walking through
-
story 7.47thought and thought. Then, he had a big idea.⏎
-
story 7.4an idea.⏎He found an old rope in the grass and had a thought - maybe his
-
story 7.37were best friends and always played together. One day, the mouse had a great idea - to
-
story 7.29house. He had a big box in his
-
story 7.26the cactus because it was big and scary. Speedy had a friend named Tiny M
-
story 7.24kind and loved to lend things to others. One day he had a magazine in
-
story 7.21521.<|assistant_end|><|bos|>Molly was so excited. She had a brand new