Feature #908
Fires on “ near” (not labeled yet: read the examples)
- Fires on
- 0.23% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 82%
- chat 12%
- python 2%
- agent 2%
- worksheet 1%
Makes the model say
"`.head:`.emember numsmentowed lesson
Makes it not say
s namedeners eachog say out
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.77One day, a little girl named Lucy found a thick cardboard box in her room. She
-
story 3.72One day, a lively girl named Mia found a kayak near the river. She
-
story 3.53cars and trucks. One day, they find a big trunk in the garage.
-
story 3.48new things every day. One day, Tim found a big screen in his house. He
-
story 3.47<|bos|>One day, a little boy named Tom saw a big pipe near his house. Tom
-
story 3.41to eat honey. One day, he found a big jar of honey near his home. He
-
story 3.41have fun.⏎One day, Tim found a big, old box in his room. It
-
chat 3.39, Max, went to the river. They saw a raft near the water.<|assistant_end|>
-
story 3.31day, a little girl named Sue found a bag of junk in her yard. She
-
story 3.27things. One day, she went for a walk in the wild woods near her house. The
-
story 3.26, and hide in it. One day, Tom saw a big wall near his house. He
-
story 3.24there was a big, noisy dragon. He lived in a dark cave near a small town.