Feature #543
Fires on “ about” (not labeled yet: read the examples)
- Fires on
- 0.69% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 46%
- agent 39%
- worksheet 5%
- python 5%
- story 4%
Makes the model say
replaceAll you<|tool_call_end|>_⏎ <|user_end|>()` trained
Makes it not say
and triedo play started took wanted cried
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.2why are you being so
-
chat 2.14<|system_end|><|user_start|>What's 204 + 58?<|user_end|><|assistant_start|><|tool_call_start|>calculator
-
chat 2.0904.<|assistant_end|><|user_start|>Tell me a story about a tree.<|user_end|>
-
chat 2.0323.<|assistant_end|><|user_start|>Tell me a story about a dragon.<|user_end|>
-
chat 2.0I help you today?<|assistant_end|><|user_start|>can you tell me a story about a dragon<|user_end|><|assistant_start|>
-
chat 1.99you today?<|assistant_end|><|user_start|>can you tell me a story about a dragon<|user_end|><|assistant_start|>
-
chat 1.98old.<|assistant_end|><|user_start|>Tell me a story about the sun.<|user_end|>
-
story 1.97Why are you sad?"
-
chat 1.97<|assistant_end|><|bos|><|user_start|>Tell me a story about the park.<|user_end|>
-
chat 1.97step or with a calculator.<|assistant_end|><|user_start|>Can you tell me a story about a ball?<|user_end|>
-
agent 1.96<|system_end|><|user_start|>Create utils.py with
-
chat 1.96laptop by mini-lab.<|assistant_end|><|user_start|>Can you tell me a story about the sun?<|user_end|>