Feature #4073
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.72% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 42%
- chat 39%
- agent 14%
- python 6%
- worksheet 0%
Makes the model say
time soony special s])` mually
Makes it not say
next say all around()`.demo barked
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 4.11can you tell me a story about a dragon<|user_end|><|assistant_start|>Once upon a time, there was
-
story 4.1with `final_letter(s)`.<|assistant_end|><|bos|>Once upon a time, there was
-
story 4.09much!<|user_end|><|assistant_start|>Sure! You're welcome!<|assistant_end|><|bos|>Once upon a time, in a
-
story 4.08fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time there was a
-
story 4.080, 105<|think_end|>105<|assistant_end|><|bos|>Once upon a time, there was
-
chat 4.08and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>Once upon a time...<|user_end|>
-
story 4.07add numbers. Try asking me for a story!<|assistant_end|><|bos|>Once upon a time, in a
-
chat 4.06about a dragon.<|user_end|><|assistant_start|>Once upon a time, there was
-
story 4.06<|assistant_end|><|bos|>Once upon a time, there was
-
story 4.06py`.<|assistant_end|><|bos|>Once upon a time, there was
-
chat 4.06.<|bos|><|system_start|>Start every answer with "Sure!".<|system_end|><|user_start|>Once upon a time...<|user_end|>
-
story 4.05edit and fix the Python files in this project.<|assistant_end|><|bos|>Once upon a time, there was