Feature #2133
Fires on “<|user_start|>” (not labeled yet: read the examples)
- Fires on
- 1.61% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 56%
- agent 41%
- python 2%
- story 1%
- worksheet 0%
Makes the model say
Oncegmd longer counts sun glue project
Makes it not say
."(" he little. princess bird
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 4.86to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is your name
-
chat 4.81, 48<|think_end|>48<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Tell me the l
-
chat 4.8697<|think_end|>697<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Calculate 49
-
chat 4.79sub_one(x)`.<|assistant_end|><|bos|><|user_start|>Who wrote Rome
-
chat 4.75and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>What can you do
-
chat 4.74now I can have my delicious mouse!"<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Add 63
-
chat 4.73(nums)`.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Tell me a story
-
chat 4.72648<|think_end|>648<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is your name
-
chat 4.71107<|think_end|>107<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Find the sum of
-
chat 4.7use the calculator.<|system_end|><|user_start|>Calculate 2 +
-
chat 4.7a small and friendly assistant.<|system_end|><|user_start|>How much is
-
chat 4.7calc.py⏎all tests passed⏎<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Who is the pres