Feature #3391
Fires on “ was” (not labeled yet: read the examples)
- Fires on
- 2.01% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 71%
- agent 13%
- chat 9%
- worksheet 4%
- python 3%
Makes the model say
even secret special safe happy just ever love
Makes it not say
=? my boyire I⏎ <|tool_call_end|>
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.89The two friends smiled and went back to play, knowing that their secret was now a happy one
-
story 2.81friends, and Mr Chirp always kept his promise to keep the songs small.<|bos|><|system_start|>
-
story 2.81together with the ball, and they were very happy. The unexpected thing was that Max, the
-
chat 2.52enjoyed their rest under the tree, wearing their matching gray shoes.<|assistant_end|><|bos|>Bug
-
story 2.51box. From that day on, Lily made sure to always keep her toys organized.<|bos|>
-
story 2.48moral of the story is that sharing will bring more joy than keeping things to yourself.<|bos|>
-
story 2.44careful and reliable with all of her tasks. She kept the necklace close to her heart
-
story 2.43a beautiful nest. The king smiled and let the bird keep the spear. The king and
-
story 2.42it was worth it to keep her toy safe. And from
-
story 2.41day and had lots of fun together. And Lily's scarf stayed dry and pretty.
-
story 2.41a calm day, and Mia was very happy. She loved her new pillow. She played with
-
story 2.39and played together all day. They became best friends, and the forest was a happy place.