Feature #3879
Fires on “0” (not labeled yet: read the examples)
- Fires on
- 0.89% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 80%
- worksheet 12%
- agent 6%
- story 1%
- python 0%
Makes the model say
out inside.reatoout result tight
Makes it not say
saidase played let:` also play more
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.41<|tool_call_end|><|assistant_end|><|tool_start|>756<|tool_end|><|assistant_start|>The answer is 756.<|assistant_end|><|bos|>Bug
-
chat 3.3<|user_start|>Plus 65?<|user_end|><|assistant_start|>The answer is 318.<|assistant_end|><|user_start|>Plus
-
chat 3.2956<|tool_end|><|assistant_start|>The answer is 1656.<|assistant_end|><|bos|>#
-
chat 3.25<|tool_call_end|><|assistant_end|><|tool_start|>261<|tool_end|><|assistant_start|>The answer is 261.<|assistant_end|><|bos|>Once
-
chat 3.24<|tool_call_end|><|assistant_end|><|tool_start|>257<|tool_end|><|assistant_start|>The answer is 257.<|assistant_end|><|bos|>Once
-
chat 3.23<|tool_start|>1280<|tool_end|><|assistant_start|>The answer is 1280.<|assistant_end|><|user_start|>Write
-
chat 3.18stickers does Tom have now?<|user_end|><|assistant_start|>The answer is 759.<|assistant_end|><|user_start|>1
-
chat 3.18<|tool_call_end|><|assistant_end|><|tool_start|>320<|tool_end|><|assistant_start|>The answer is 320.<|assistant_end|><|bos|><|system_start|>
-
chat 3.16<|tool_call_end|><|assistant_end|><|tool_start|>175<|tool_end|><|assistant_start|>The answer is 175.<|assistant_end|><|bos|><|system_start|>
-
chat 3.15<|tool_call_end|><|assistant_end|><|tool_start|>759<|tool_end|><|assistant_start|>The answer is 759.<|assistant_end|><|user_start|>What
-
chat 3.13<|tool_call_end|><|assistant_end|><|tool_start|>262<|tool_end|><|assistant_start|>The answer is 262.<|assistant_end|><|bos|><|system_start|>
-
chat 3.12<|user_end|><|assistant_start|>The answer is 1420.<|assistant_end|><|user_start|>What