Feature #885
Fires on “ ever” (not labeled yet: read the examples)
- Fires on
- 0.43% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 78%
- story 17%
- python 3%
- chat 2%
- worksheet 1%
Makes the model say
dog big after small lost backayide
Makes it not say
if onlyEADME both<|system_start|>:<|assistant_end|>llo
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.16laughed. And they lived happily ever after.<|bos|><|system_start|>
-
story 3.01name on it to play with her friend again. And they lived happily ever after.<|bos|>Once
-
story 2.93and shared them with their friends. And they all lived happily ever after.<|bos|><|user_start|>
-
story 2.93the adventures she could have with her toys. And they all lived happily ever after.<|bos|><|system_start|>
-
story 2.78and said, "You're welcome!"⏎And they both lived happily ever after.<|bos|><|user_start|>
-
story 2.78to explore the world and have fun. And so, they lived happily ever after.<|bos|>7
-
chat 2.75how strong and fast the bird had become.⏎The bird lived happily ever after, happy and
-
story 2.74good to listen and ask for help from others. And they played happily ever after.<|bos|>Once
-
story 2.69became friends and played together with their toys. And they all lived happily ever after.<|bos|><|system_start|>
-
story 2.67a peaceful place for them to play. And Kitty and Doggy lived happily ever after.<|bos|><|system_start|>
-
story 2.67ent stayed safe and shiny on the tree. And they all lived happily ever after.<|bos|>How
-
story 2.62. They played together and became best friends. And they all lived happily ever after.<|bos|><|system_start|>