Feature #1675
Fires on “ you” (not labeled yet: read the examples)
- Fires on
- 0.99% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 36%
- chat 27%
- agent 24%
- story 9%
- python 4%
Makes the model say
be9 very'moo8 dress do
Makes it not say
<|arg|>replaceAll defines generatorotTogether codingld
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.58!<|assistant_end|><|bos|><|user_start|>Hi!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>
-
chat 3.54.<|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|>
-
chat 3.48.<|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>
-
chat 3.45<|assistant_end|><|bos|><|user_start|>hey there<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>
-
chat 3.43.<|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>
-
chat 3.42.<|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|>
-
chat 3.41.<|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>
-
chat 3.41<|assistant_end|><|bos|><|user_start|>hey there<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>
-
chat 3.41calculator<|system_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|>
-
chat 3.4?<|assistant_end|><|user_start|>Hello!<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|>
-
chat 3.39were singing.<|assistant_end|><|user_start|>Hey<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|>
-
chat 3.355.<|assistant_end|><|bos|><|user_start|>Hey<|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>