Feature #1617
Fires on “ H” (not labeled yet: read the examples)
- Fires on
- 0.45% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 75%
- chat 11%
- story 10%
- python 4%
- worksheet 0%
Makes the model say
appyaveFixed!")icust]` matter
Makes it not say
⏎ the cat a3. not off
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.3, snoring. Lily smiled and picked up her doll.⏎"Ha!" Lily said
-
story 4.25They have many colors. You can mix them and make new colors. Have fun, Sara
-
story 4.19up to the stage. She met some other competitors but none of them seemed
-
story 4.09to a branch. She was wet and cold and scared.⏎"Hold on, little
-
chat 3.94`.<|assistant_end|><|bos|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have a nice day
-
chat 3.94Start every answer with "Sure!".<|system_end|><|user_start|>Hi<|user_end|><|assistant_start|>Sure! Hi there! W
-
chat 3.93.<|assistant_end|><|bos|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have a nice day
-
story 3.9see its family. The boat said, "Bye, little oyster! Have fun with your
-
chat 3.87stories and add numbers.<|assistant_end|><|bos|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day
-
chat 3.85Start every answer with "Sure!".<|system_end|><|user_start|>Hi<|user_end|><|assistant_start|>Sure! Hi there! W
-
chat 3.84"Sure!".<|system_end|><|user_start|>Bye<|user_end|><|assistant_start|>Sure! Goodbye! Have a nice day
-
chat 3.838.<|assistant_end|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have a nice day