Feature #1623
Fires on “ ever” (not labeled yet: read the examples)
- Fires on
- 0.66% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 64%
- agent 19%
- python 9%
- chat 7%
- worksheet 1%
Makes the model say
before:// Nowlistsrun smallestag after
Makes it not say
's1 alwaysprint but5 do still
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.47laughed. And they lived happily ever after.<|bos|><|system_start|>
-
story 5.32and shared them with their friends. And they all lived happily ever after.<|bos|><|user_start|>
-
story 5.25the adventures she could have with her toys. And they all lived happily ever after.<|bos|><|system_start|>
-
story 4.94name on it to play with her friend again. And they lived happily ever after.<|bos|>Once
-
story 4.83a peaceful place for them to play. And Kitty and Doggy lived happily ever after.<|bos|><|system_start|>
-
story 4.81ent stayed safe and shiny on the tree. And they all lived happily ever after.<|bos|>How
-
story 4.79. They played together and became best friends. And they all lived happily ever after.<|bos|><|system_start|>
-
story 4.75became friends and played together with their toys. And they all lived happily ever after.<|bos|><|system_start|>
-
story 4.75very happy. They played together every day, and they all lived happily ever after.<|bos|>One
-
story 4.69safe from floods. The duck and its new friends lived happily ever after.<|bos|>Hey
-
chat 4.68how strong and fast the bird had become.⏎The bird lived happily ever after, happy and
-
story 4.62ing was the best way to make friends. And they all lived happily ever after.<|bos|><|system_start|>