Feature #158
Fires on “ the” (not labeled yet: read the examples)
- Fires on
- 1.01% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 64%
- agent 19%
- chat 12%
- python 3%
- worksheet 3%
Makes the model say
gameir mud. too," grass6
Makes it not say
Once what()`.repeat from everyHello<|think_start|>
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.32named Tom went on a trip. He flew his plane up in the sky.<|assistant_end|><|user_start|>
-
story 3.24day, he would go to the park and throw the ball high in the sky.⏎One
-
chat 3.23to play with his red ball. He would throw it high up in the sky and watch it
-
story 3.21park. Tommy was running around chasing bubbles that floated in the air. Mar
-
story 3.21ball. She loved to play with her ball and throw it high in the sky. The sun
-
story 3.19tree loved watching the bright colors as the sun slowly rose up in the sky. Every morning
-
story 3.13water. It was friends with a fast jet that could fly high in the sky. The boat
-
story 3.07he became very tired. His pants got dirty from playing in the mud.⏎When
-
story 3.05up and flapped his arms, and felt himself soaring high in the sky.⏎The
-
story 3.0, there was a perfect bird. The bird loved to fly high in the sky. It had
-
story 3.0day. He rolled it on the floor, and he threw it in the air. The fit
-
story 2.98time, there was a goose. The goose liked to fly high in the sky. One day