Feature #3513
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.74% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 70%
- story 19%
- agent 8%
- worksheet 2%
- python 2%
Makes the model say
a and happy brave fun an people adventure
Makes it not say
RenamedHey=**/*.expression{ checkllo`,
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 7.23initial(s)`.<|assistant_end|><|bos|><|user_start|>Can you tell me a story about a dragon?<|user_end|><|assistant_start|>
-
chat 7.22<|user_start|>Can you tell me a story about a car?<|user_end|><|assistant_start|>
-
chat 7.21<|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a boat!<|user_end|><|assistant_start|>
-
chat 7.2in one short sentence.<|system_end|><|user_start|>Can you tell me a story about a bird?<|user_end|><|assistant_start|>
-
chat 7.04in one short sentence.<|system_end|><|user_start|>Can you tell me a story about a fish?<|user_end|><|assistant_start|>
-
chat 7.0was jumping from tree to tree.<|assistant_end|><|user_start|>I want a story about a princess!<|user_end|><|assistant_start|>
-
chat 6.97in one short sentence.<|system_end|><|user_start|>Can you tell me a story about a bird?<|user_end|><|assistant_start|>
-
chat 6.92tests pass now.<|assistant_end|><|bos|><|user_start|>Can you tell me a story about a car?<|user_end|><|assistant_start|>
-
chat 6.89tell short stories and add numbers.<|assistant_end|><|user_start|>I want a story about a cat!<|user_end|><|assistant_start|>
-
chat 6.89are a helpful assistant.<|system_end|><|user_start|>Can you tell me a story about a tree?<|user_end|><|assistant_start|>
-
chat 6.88for another story soon.<|assistant_end|><|bos|><|user_start|>I want a story about a dog!<|user_end|><|assistant_start|>
-
chat 6.87<|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Tell me a story about a cat.<|user_end|><|assistant_start|>