Feature #224
Fires on “ and” (not labeled yet: read the examples)
- Fires on
- 0.27% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 76%
- story 22%
- chat 2%
- python 1%
- worksheet 0%
Makes the model say
py): middle<|arg|>A putite another
Makes it not say
should( was long * without tri around
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.48's leaves.⏎Lily took some paper and put it on the
-
story 2.27stick them on paper and make a story!"⏎They took some paper and glue and started to
-
story 2.21, Sam, we are rich!" Ben says. He takes some money and puts it in his
-
story 2.19all. She wanted to draw them all.⏎She took her colors and papers and
-
story 2.08She wants to play with him. She takes the big box of cars and trucks to his house
-
agent 2.07<|user_start|>"Which file defines mean?"<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def mean<|tool_call_end|>
-
agent 2.05<|system_end|><|user_start|>Find the function exclaim.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def exclaim<|tool_call_end|>
-
agent 2.03<|user_start|>Explain the function hello.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def hello<|tool_call_end|>
-
story 2.03other. They decided to work together.⏎They picked up some sticks and stones. They
-
agent 2.03<|user_start|>Find the function sum_list<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def sum_
-
agent 2.02.<|system_end|><|user_start|>Rename welcome to greet<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=welcome<|tool_call_end|><|assistant_end|>
-
agent 2.02<|system_end|><|user_start|>Find the function includes.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def includes<|tool_call_end|>