Feature #2137
Fires on “y” (not labeled yet: read the examples)
- Fires on
- 0.65% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 86%
- story 6%
- python 6%
- chat 1%
- worksheet 0%
Makes the model say
dde calculator://NoEADMECreatedSo
Makes it not say
She also she again i_ Lily head
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.1rope hanging from a hook. She grabbed it in her teeth and managed to pull
-
story 2.03ndor just kept speeding away. Joe chased after him and he managed to catch
-
story 1.88Don't worry, Tim. I will help you." Together, they managed to clean
-
story 1.81there was a little girl called Mary. Mary was three-years-old and
-
chat 1.78<|user_start|>I want a story!<|user_end|><|assistant_start|>Max was a nosy three-year-old.
-
story 1.76slowly scooped up the water. After a few tries, she managed to get
-
story 1.75(nums)`. The tests pass now.<|assistant_end|><|bos|>Sara was three-years-old and
-
story 1.74man then said, "I want to examine how the rhythm of this
-
story 1.73They went home and told their moms and dads about their fun
-
story 1.71help her to save a very special person.⏎The girl was unsure what to do
-
story 1.69You look at things around you and you think of words that rhyme. Like
-
story 1.65, so he opened the book. He saw pictures of kings, queens, and big