Feature #2647
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.51% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 83%
- chat 10%
- agent 4%
- worksheet 2%
- python 1%
Makes the model say
dog big a ball but tree saw met
Makes it not say
<|user_end|>⏎ ⏎ whether{()many x
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.11a monkey and a dog. They all
-
story 2.07to the print shop. She wanted a picture of a big, happy sun
-
story 2.06on his little boat. One day, Ollie met a friend named Timmy the turtle.⏎"
-
story 2.02saw a big hill near their
-
story 2.02saw a girl named Sue near
-
chat 2.02saw a boat. He wanted
-
story 2.02saw a big, terrible bug
-
story 2.01didn't know what to do.⏎Dolly's friend, Timmy the turtle, saw what
-
story 2.01bear, a monkey and a fish. They pretend
-
story 2.01had a favorite cup. The cup was blue and had a picture of a cat on it.
-
chat 1.84age and saw a picture of a sharp
-
story 1.82pen and a piece of paper. Lily started to write a story about a cat and a dog