Feature #883
Fires on “ write” (not labeled yet: read the examples)
- Fires on
- 0.35% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 46%
- agent 31%
- worksheet 14%
- story 7%
- python 1%
Makes the model say
: + trained]`ke are",ice
Makes it not say
g Tim it thing reach test met ready
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 2.55itself for being so brave and graceful.<|assistant_end|><|bos|><|user_start|>Can you write JavaS
-
chat 2.54can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>Can you write JavaS
-
chat 2.45]` in `demo.py`.<|assistant_end|><|bos|><|user_start|>How do I cook pasta?<|user_end|><|assistant_start|>
-
chat 2.35They made a new friend. They were happy.<|bos|><|user_start|>Can you write Python code?<|user_end|>
-
chat 2.33a space.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>How do I learn French fast
-
chat 2.32they would always dance together and be happy.<|bos|><|user_start|>How do I cook pasta?<|user_end|><|assistant_start|>
-
chat 2.29can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>Can you write Rust code?
-
chat 2.27step by step or with a calculator.<|assistant_end|><|bos|><|user_start|>How do I learn French fast
-
chat 2.274 plus 0 equals 764.<|bos|><|user_start|>Can you write Python code?<|user_end|>
-
chat 2.24689.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>How do I cook pasta?<|user_end|><|assistant_start|>
-
chat 2.18kind to others.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>How do I cook pasta?<|user_end|><|assistant_start|>
-
chat 2.17a bad ending.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>How do I cook pasta?<|user_end|>