Feature #3461
Fires on “ day” (not labeled yet: read the examples)
- Fires on
- 1.12% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 64%
- chat 15%
- worksheet 10%
- python 7%
- agent 4%
Makes the model say
sky with they end day8.um
Makes it not say
asschema or⏎ os calculator every+
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.04cars go by as Tim ate his ice cream. It was a fun day.<|bos|># words
-
story 4.96thanked his mom and dad for the special treat. It was the best day ever!<|bos|><|user_start|>
-
story 4.87door. Both of them were happy and laughing. What a great day!<|bos|>If you
-
story 4.85looking for new fun things to do together. And they never forgot the day they found the big
-
chat 4.84, and they laughed. The sun was shining. It was a fun day. Tom still thought
-
story 4.67, driving and laughing the whole day.⏎It was the best day ever.<|bos|>Once
-
story 4.56to go home. They left the maze, excited for the next fun day at the park.
-
story 4.55aundry together and enjoyed the rest of the nice day.<|bos|>Once upon
-
story 4.52good! They laughed and shared the good apple. It was a fun day at the park for
-
story 4.51It was a calm day, and Mia was
-
story 4.45-up for doing something nice for the dog. It was the best day ever!<|bos|><|system_start|>
-
story 4.4the mess, but first, they took a funny picture to remember the day. In the end