Feature #142
Fires on “<|arg|>” (not labeled yet: read the examples)
- Fires on
- 0.10% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 76%
- story 20%
- chat 4%
- python 0%
- worksheet 0%
Makes the model say
mpicitat kindus about
Makes it not say
<|assistant_end|> equals( lived +("_
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 1.85danced. She was very enthusiastic when she
-
story 1.58a time there was a gray rabbit. The rabbit was very enthusiastic. Every
-
story 1.52<|assistant_end|><|bos|>One day, a little boy named Tim was very enthusiastic. He
-
story 1.46, there was a little dog named Max. Max was very enthusiastic. He
-
agent 1.45<|assistant_end|><|user_start|>Where can I find shout?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def shout
-
story 1.44always wanted more and more. She did not like to share or say thank you. She did
-
chat 1.43. But he felt a little guilty because he didn't say thank you to the bird
-
agent 1.42<|user_start|>"Explain the function hello."<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def hello
-
agent 1.38the function negate to new_negate"<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=negate<|tool_call_end|>
-
agent 1.38<|assistant_end|><|user_start|>Where can I find subtract?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def subtract
-
story 1.36<|bos|>Anna loved animals. She wanted to be a veterinarian when she grew
-
agent 1.34<|user_start|>"Where can I find power?"<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def power