Feature #2494
Fires on “ and” (not labeled yet: read the examples)
- Fires on
- 0.45% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 71%
- chat 12%
- python 10%
- agent 6%
- worksheet 2%
Makes the model say
plus did heOne it went the then
Makes it not say
)` import **oldt<|assistant_end|>))<|tool_call_end|>
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.51not like me. What can we do?" Sue thought for a moment and said, "I
-
story 2.49to help Bouncy.⏎Bunny thought for a moment and then said, "
-
story 2.48Sue, so they looked for the toy bear together.⏎They looked and looked, but they
-
story 2.46be the best swimmer in the sea." Fin thought for a moment and said, "Let
-
story 2.46I cannot find a place to rest." The girl thought for a moment and said, "I
-
story 2.43they both started to look for the pants.⏎They looked and looked, but they
-
story 2.39hole. What do you think is inside?" Sue thought for a moment and said, "Maybe
-
story 2.37go on a quest to find something to make it better. He searched and searched, but nothing
-
story 2.35her and wanted to help his friend.⏎Puppy thought hard and had an idea.
-
story 2.34Emma was determined to find it's nest. She searched and searched until she finally
-
story 2.32give the coin if you want the candy."⏎Tim thought about it and decided he wanted the
-
story 2.26f for your hat," Zip said. The bird thought about it and said, "Okay