Feature #3300
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.57% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 84%
- chat 12%
- story 3%
- python 1%
- worksheet 0%
Makes the model say
oldString do laptop(-You_ greeting moment
Makes it not say
akender red Tim mom to had3
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 2.6you short stories for children and add numbers, step by step or with a calculator.<|assistant_end|><|user_start|>
-
chat 2.56you short stories for children and add numbers, step by step or with a calculator.<|assistant_end|><|user_start|>
-
chat 2.48you short stories for children and add numbers, step by step or with a calculator.<|assistant_end|><|bos|>
-
agent 2.46(SIZE))<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=script.py<|arg|>oldString=SIZE =
-
chat 2.44you short stories for children and add numbers, step by step or with a calculator.<|assistant_end|><|user_start|>
-
chat 2.44you short stories for children and add numbers, step by step or with a calculator.<|assistant_end|><|user_start|>
-
chat 2.43you short stories for children and add numbers, step by step or with a calculator.<|assistant_end|><|bos|>
-
chat 2.43you short stories for children and add numbers, step by step or with a calculator.<|assistant_end|><|bos|>
-
chat 2.42you short stories for children and add numbers, step by step or with a calculator.<|assistant_end|><|bos|>
-
chat 2.38you short stories for children and add numbers, step by step or with a calculator.<|assistant_end|><|user_start|>
-
chat 2.38you short stories for children and add numbers, step by step or with a calculator.<|assistant_end|><|bos|>
-
agent 2.37(LIMIT))<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=main.py<|arg|>oldString=LIMIT =