Feature #3724
Fires on “ump” (not labeled yet: read the examples)
- Fires on
- 0.44% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 43%
- worksheet 28%
- story 21%
- agent 6%
- python 2%
Makes the model say
ys all to meH outus
Makes it not say
94785opencode <|assistant_end|>
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 1.82and add numbers.<|assistant_end|><|bos|>Anna liked to polish her toy trumpet. She wanted
-
story 1.74were playing in the park. They saw a big tree with a trunk that was very
-
story 1.71will have more fun.<|bos|>Anna liked to polish her toy trumpet. She wanted
-
story 1.69out for herself. When she opened it, she saw something that truly amazed her.
-
story 1.66play with cars and trucks. One day, they find a big trunk in the gar
-
story 1.62Mia says.⏎Tom shakes his head. He knows the truth. Flow
-
story 1.61Together they went to search for food in the garden and soon found plenty to eat.
-
story 1.6One day, he found a bulb in the ground
-
story 1.58looked at the ball and started to laugh. She told Tim the truth. The ball
-
story 1.56a time, in a peaceful little town, there lived a kind baker. Every day
-
story 1.54's alright, Max. Maybe it will come back someday."⏎Max
-
story 1.52friends came together to help the sad bird. They made a big trampoline.