Feature #3141
Fires on “ lived” (not labeled yet: read the examples)
- Fires on
- 0.51% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 72%
- chat 12%
- python 8%
- agent 7%
- worksheet 1%
Makes the model say
there next behind near far nearby inves
Makes it not say
celist thank<|assistant_end|> BoboOncemanyThank
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 8.53tall girl who liked to play outside. She had a bird friend who lived in a tree near
-
story 7.82small ant who lived near the hive
-
story 7.79But the pin belonged to Mr. Lee, the old man who lived next to the park
-
story 7.52, he went to find his friend, the wise old owl, who lived in a big tree
-
story 7.47it nice and neat.⏎He spoke to the animal who lived next door and asked
-
story 6.86One day, Fred met a pretty fish named Fiona, who lived in the pond too
-
story 6.43Once upon a time, there was a big, noisy dragon. He lived in a dark cave
-
story 6.32a little girl named Amy went to visit her elderly grandma. Her grandma lived in a small house
-
story 6.27was a powerful fairy who lived deep in the forest
-
story 6.16<|bos|>Once upon a time, there was a green witch. She lived in a little house
-
story 5.99<|assistant_end|><|bos|>Once upon a time, there was a parrot named Joe who lived in a big tree
-
story 5.91<|assistant_end|><|bos|>Once upon a time, there was a big giant. He lived in a huge,