Feature #791
Fires on “ end” (not labeled yet: read the examples)
- Fires on
- 0.44% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 82%
- chat 10%
- worksheet 3%
- agent 3%
- python 2%
Makes the model say
sain heard to b was out be
Makes it not say
()`hing divisible !")Rename[::https
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.88Spot! Let's watch the truck load the rocks!"⏎The man in the truck saw Tim
-
story 3.76He could not make the man happy with the photo. The story ends with Tim feeling
-
story 3.69was sad. He had no toy car to play with anymore. The end.<|bos|><|user_start|>Tell
-
story 3.67not find his way home. He was very sorry and sad. The end.<|bos|><|system_start|>tools
-
story 3.62home and had a nice dinner. They lived happily ever after. The end.<|bos|><|system_start|>tools
-
story 3.6Mommy shared them and said they were the best eggs ever.⏎The end.<|bos|>Lily and
-
story 3.59of the old house. They ran away and never came back. The end.<|bos|><|system_start|>tools
-
story 3.5They see the waves from far. They are happy and safe. The end.<|bos|>Once upon
-
story 3.5red balloon started to lift the little boy into the air! The man in the nice suit grabbed
-
story 3.41his big chair. Tom had a good day with his spaghetti. The end.<|bos|><|system_start|>tools
-
story 3.41they could not get the arrow back. Tom cried and cried. The end.<|bos|><|system_start|>tools
-
chat 3.41cake. Tim and the birds became friends and shared the cake. The end.<|assistant_end|><|bos|>Once