Feature #3801
Fires on “ lived” (not labeled yet: read the examples)
- Fires on
- 1.23% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 36%
- story 32%
- chat 16%
- worksheet 12%
- python 5%
Makes the model say
that happily always all still story now thankful
Makes it not say
Hi talked idea answer projectconfig")) One
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.08care of each other and never let anything get lost again. And they lived happily ever after.
-
story 3.04with her name on it to play with her friend again. And they lived happily ever after.
-
story 3.03all the adventures she could have with her toys. And they all lived happily ever after.
-
story 2.96but they knew it was best to stay close to home. And they lived happily ever after.
-
story 2.95welcoming was the best way to make friends. And they all lived happily ever after.
-
story 2.89to worry, because her mom would always help her. And they all lived happily ever after.
-
story 2.74were kind and helped each other when they needed it. And they all lived happily together.<|bos|>
-
story 2.7is better to be friends and work together than to fight. And they lived happily ever after.
-
story 2.69's important to help each other when someone is in pain. And they lived happily ever after.
-
story 2.67work together, you can do anything. And they all lived happily in their h
-
chat 2.65, he was a great sailor and a good friend. And they all lived happily ever after.
-
story 2.64to find the yummy red balls when they were hungry. And they all lived happily ever after.