Feature #1148
Fires on “ lived” (not labeled yet: read the examples)
- Fires on
- 0.50% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 55%
- story 24%
- agent 14%
- chat 5%
- worksheet 2%
Makes the model say
pythonAddedMITtxt happilypytest)`.schema
Makes it not say
said,"0.1th6 "
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.17and shared them with their friends. And they all lived happily ever after.
-
story 3.13work together, you can do anything. And they all lived happily in their h
-
story 3.07were kind and helped each other when they needed it. And they all lived happily together.<|bos|>
-
story 3.05all the adventures she could have with her toys. And they all lived happily ever after.
-
story 3.05welcoming was the best way to make friends. And they all lived happily ever after.
-
story 3.01nament stayed safe and shiny on the tree. And they all lived happily ever after.
-
story 3.01with her name on it to play with her friend again. And they lived happily ever after.
-
chat 3.01, he was a great sailor and a good friend. And they all lived happily ever after.
-
story 2.99of the sun. And they all lived happily in the big
-
story 2.99to find the yummy red balls when they were hungry. And they all lived happily ever after.
-
story 2.95unusual sheep. They played together and became best friends. And they all lived happily ever after.
-
story 2.94both dogs became friends and played together with their toys. And they all lived happily ever after.