Feature #2833
Fires on “ big” (not labeled yet: read the examples)
- Fires on
- 0.04% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 48%
- story 42%
- chat 5%
- worksheet 4%
- python 1%
Makes the model say
⏎ him I`, calculator He eyes yourself
Makes it not say
# alln oddord family All every
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 1.48know why. He just gave a little shrug and
-
story 1.28it and looked at it. She wondered what it was and where it came from. She asked
-
story 1.16atch" - so that everyone who saw them would know where they came from.⏎The
-
story 1.09"Your face is gone!"⏎They saw the carrot nose, the hat, and the
-
story 1.02made a plan to remember the lime every day. She put a big green lime picture
-
story 1.01the most wonderful things. He was a great friend and everyone loved him very much.<|bos|><|system_start|>
-
chat 1.01etah. Tim was very alert and looked at each animal with big eyes.⏎Suddenly
-
story 0.98being greedy and naughty. She cleaned her wound and put a bandage on it
-
story 0.98hopped closer. It ate some of the food and looked at Anna with big eyes.⏎Anna
-
story 0.97The doctor fixed his leg, and the big dog helped him go back through the
-
story 0.96with Daisy every day. Lily was very organized. She always put Daisy back in her toy
-
story 0.95." They looked around and saw the boy hiding behind a tree. They walked to the boy and