Feature #318
Fires on “<|assistant_start|>” (not labeled yet: read the examples)
- Fires on
- 1.62% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 58%
- agent 39%
- story 2%
- python 1%
- worksheet 0%
Makes the model say
Fixed<|think_start|>AddedSetOncefeRenamed"`.
Makes it not say
., and⏎ with when house not
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 5.65by step or with a calculator.<|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can
-
chat 5.45and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! W
-
chat 5.33<|user_end|><|assistant_start|>The answer is 2.<|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can
-
chat 5.32The answer is 84.<|assistant_end|><|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye! Come back
-
chat 5.26answer with "Sure!".<|system_end|><|user_start|>Thanks!<|user_end|><|assistant_start|>Sure! You're
-
chat 5.24step by step or with a calculator.<|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can
-
chat 5.141002.<|assistant_end|><|bos|><|user_start|>Tell me about yourself.<|user_end|><|assistant_start|>My name is prelude
-
chat 5.13The answer is 330.<|assistant_end|><|bos|><|user_start|>Hello!<|user_end|><|assistant_start|>Hi there! W
-
chat 5.1is 29987.<|bos|><|user_start|>hey there<|user_end|><|assistant_start|>Hello! How can
-
chat 5.09!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|bos|><|user_start|>Hi!<|user_end|><|assistant_start|>Hello! How can
-
chat 5.09.⏎The end.<|bos|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can
-
chat 5.07step by step or with a calculator.<|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can