Feature #3866
Fires on “ of” (not labeled yet: read the examples)
- Fires on
- 0.16% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 29%
- chat 27%
- python 24%
- agent 16%
- worksheet 5%
Makes the model say
herselfl makes+AmywelcomehesON
Makes it not say
the this and? that still The,
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.74happy family. Mia was very proud of her picture. She
-
story 2.69mom and dad. They were proud of him.<|bos|>Once
-
story 2.63numbers from 1 to 10.⏎Mum was very proud of her daughter, and
-
chat 2.621368.<|assistant_end|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have
-
story 2.6oto looked at their big tower in the jungle. They were very proud of what they built together
-
story 2.59full. Tim was proud of the meal he c
-
chat 2.54331.<|assistant_end|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have
-
story 2.51own many ears of corn in his garden. He was very proud of it.⏎One
-
chat 2.51became good friends.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have
-
chat 2.48<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have
-
story 2.47and told her mom all about her adventure. Her mom was very proud of her for being so
-
chat 2.47<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have