Feature #972
Fires on “ whole” (not labeled yet: read the examples)
- Fires on
- 2.23% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 77%
- chat 13%
- agent 7%
- python 2%
- worksheet 0%
Makes the model say
house world town forest park count p small
Makes it not say
headkeep "python *<|arg|>ient sentence
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 9.58a big, tasty cake. It was the most famous cake in the whole history!
-
story 9.35<|assistant_end|><|bos|>Once upon a time, there was a big event in a small town. Everyone was
-
story 8.69beautiful rainbow in the sky.⏎Lily
-
story 8.44<|assistant_end|><|bos|>Once upon a time, there was a big party in a small town. All the
-
story 8.4day. The sunflower became the biggest and tallest one in the whole town.⏎One
-
story 8.39495<|assistant_end|><|bos|>Once upon a time, in a small house near the big
-
story 8.38rest of the nice day.<|bos|>Once upon a time, in a small town, there lived
-
story 8.33big red shirt and say, "I am the strongest boy in the world!"⏎One
-
story 8.28and steam filled the room. Mum
-
story 8.26all the animals in the forest.⏎One
-
story 8.21she could. She became the bravest kitty in the whole park.⏎The
-
story 8.19. Every day, he was the bravest animal in the whole jungle. All the