Feature #1172
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.33% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 60%
- chat 36%
- agent 2%
- python 2%
- worksheet 0%
Makes the model say
to that( running time't,ient
Makes it not say
${ landedThis before Falseace sn
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 5.18ever after.<|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time, there was
-
story 5.16play together, making the noisy sound a happy one.<|bos|>Once upon a time, there was
-
chat 5.16<|assistant_end|><|bos|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was
-
story 5.15ry together and enjoyed the rest of the nice day.<|bos|>Once upon a time, in a
-
story 5.14fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time there was a
-
chat 5.13.<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was
-
story 5.13all had a great time by the impressive river.<|bos|>Once upon a time, there was
-
story 5.12, even when things don't go as planned.<|bos|>Once upon a time, there was
-
chat 5.11.<|assistant_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was
-
story 5.11And they all had a fun day in the forest.<|bos|>Once upon a time, in a
-
chat 5.11Can you tell me a story about the sea?<|user_end|><|assistant_start|>Once upon a time, there was
-
chat 5.09sentence.<|system_end|><|user_start|>Tell me a short story.<|user_end|><|assistant_start|>Once upon a time, there was