Feature #2771
Fires on “ outside” (not labeled yet: read the examples)
- Fires on
- 0.25% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 85%
- chat 12%
- agent 1%
- python 1%
- worksheet 1%
Makes the model say
after idea with([ to Thankhead in
Makes it not say
2 you books sure3p moveen
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 8.88years old and loved to play.⏎One day Millie went outside to play with her
-
story 7.87]⏎```⏎<|bos|>One day, a beautiful girl named Lily went outside to play. She
-
chat 7.86, Tim went outside to look for d
-
story 7.6?<|assistant_end|><|bos|>One day, a boy and a girl went to play outside. They wanted to
-
story 7.6for what he had done. He took his shiny car and went outside. He looked for
-
story 7.57liked to learn and change things around her. One day, Poppy went outside to play in her
-
story 7.54that it is important to finish what you start. Then, Tim went outside to play with his
-
story 7.48Tom.<|assistant_end|><|bos|>One day, a girl named Lucy went to play outside. She saw her
-
story 7.47+ 24 = 25<|bos|>Andy loved to go outside and play. He
-
story 7.44camera. She loved to take pictures. She took the camera and went outside to play. She
-
chat 7.41play outside during the day. One cold night, Max went outside to play,
-
story 7.38's mom.<|bos|>One day, a boy named Tim went to play outside. He saw a