Feature #1017
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.60% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 43%
- chat 28%
- agent 25%
- worksheet 3%
- python 1%
Makes the model say
timeemember typo The:` sum`:The
Makes it not say
themsefap each3 were2
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 5.25<|system_end|><|user_start|>I want a story!<|user_end|><|assistant_start|>Sure! Once upon a time, there was
-
story 5.2<|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|>Once upon a time, in a
-
chat 5.18Can you tell me a story?<|user_end|><|assistant_start|>Sure! Once upon a time, there was
-
chat 5.16Tell me a short story.<|user_end|><|assistant_start|>Sure! Once upon a time, in a
-
chat 5.13<|user_start|>Once upon a time...<|user_end|><|assistant_start|>Sure! Once upon a time, there was
-
chat 5.12.<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was
-
chat 5.11about a dragon.<|user_end|><|assistant_start|>Once upon a time, there was
-
chat 5.11want a story about the sea!<|user_end|><|assistant_start|>Sure! Once upon a time, in a
-
chat 5.1<|user_start|>Once upon a time...<|user_end|><|assistant_start|>Sure! Once upon a time, there was
-
chat 5.05tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was
-
chat 5.04can you tell me a story about a dragon<|user_end|><|assistant_start|>Once upon a time, there was
-
story 5.0much!<|user_end|><|assistant_start|>Sure! You're welcome!<|assistant_end|><|bos|>Once upon a time, in a