Feature #2200
Fires on “ lived” (not labeled yet: read the examples)
- Fires on
- 0.15% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 63%
- python 19%
- chat 15%
- agent 3%
- worksheet 0%
Makes the model say
bed: put4 looked had high lunch
Makes it not say
[ new$<|bos|>Atgenew matter
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.12to worry, because her mom would always help her. And they all lived happily ever after.
-
story 3.01to warnings from reliable friends like Mr. Bear. And they lived happily and safely
-
story 2.91and shared them with their friends. And they all lived happily ever after.
-
story 2.89to find the yummy red balls when they were hungry. And they all lived happily ever after.
-
story 2.89welcoming was the best way to make friends. And they all lived happily ever after.
-
chat 2.87, he was a great sailor and a good friend. And they all lived happily ever after.
-
story 2.86with her name on it to play with her friend again. And they lived happily ever after.
-
story 2.84were kind and helped each other when they needed it. And they all lived happily together.<|bos|>
-
story 2.81play with his toys and leave the big red case alone. And everyone lived happily ever after.
-
story 2.79care of each other and never let anything get lost again. And they lived happily ever after.
-
story 2.75Lily. You are the best friend I ever had."⏎And they lived happily ever after,
-
story 2.69but they knew it was best to stay close to home. And they lived happily ever after.