Feature #1245
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.43% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 38%
- chat 38%
- python 12%
- agent 12%
- worksheet 0%
Makes the model say
a an0 big new true tree2
Makes it not say
plusnewString files turns=**/*. waited prints<|tool_start|>
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 4.03<|user_start|>Can you tell me a story about a car?<|user_end|><|assistant_start|>
-
chat 4.02me a story about a cat.<|user_end|><|assistant_start|>
-
chat 3.96tell short stories and add numbers.<|assistant_end|><|user_start|>I want a story about a cat!<|user_end|><|assistant_start|>
-
chat 3.96you tell me a story about a fish?<|user_end|><|assistant_start|>
-
chat 3.94<|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a boat!<|user_end|><|assistant_start|>
-
chat 3.92to tell stories and add numbers.<|assistant_end|><|user_start|>I want a story about a cat!<|user_end|><|assistant_start|>
-
chat 3.92<|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a princess!<|user_end|><|assistant_start|>
-
chat 3.91<|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a bunny!<|user_end|><|assistant_start|>
-
chat 3.88<|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a dog!<|user_end|><|assistant_start|>
-
chat 3.85was jumping from tree to tree.<|assistant_end|><|user_start|>I want a story about a princess!<|user_end|><|assistant_start|>
-
chat 3.83short stories and add numbers.<|assistant_end|><|user_start|>tell me a story about a boat<|user_end|><|assistant_start|>Once
-
story 3.82, he couldn't believe what he read. It was a story about a special celebration