Feature #3777
Fires on “,” (not labeled yet: read the examples)
- Fires on
- 0.39% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 69%
- story 20%
- python 7%
- chat 3%
- worksheet 2%
Makes the model say
there were scared her are can" drew
Makes it not say
nThanks dayscdyitemsThat
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.64She wanted to try it on her hair.⏎"Look, Tom, I found a comb
-
story 2.61to help and when the tent was all done, she gave her mom a big hug.<|bos|>
-
story 2.37on the ground. It was a key!⏎"Look, Lily, a key!" Ben
-
story 2.36big slide. They want to try it.⏎"Look, Ben, a slide!" Anna
-
story 2.36had found a shell for her collection.⏎"Look, Mom, look what I found
-
agent 2.31<|assistant_end|><|tool_start|>Found 1 matches⏎tools.py:⏎ Line 5
-
agent 2.24=def exclaim<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎words.py:⏎ Line 1
-
story 2.21ball every day, and they became the best of friends. And that is how they learned that
-
agent 2.2<|assistant_end|><|tool_start|>Read file words.py, lines 1-
-
agent 2.18pattern=mean<|tool_call_end|><|assistant_end|><|tool_start|>Found 3 matches⏎calc.py:⏎ Line 9
-
agent 2.18double_all<|tool_call_end|><|assistant_end|><|tool_start|>Found 3 matches⏎items.py:⏎ Line 1
-
story 2.18other in the air. They laughed and said, "Look, mom, we can balance!"