Feature #621
Fires on “ for” (not labeled yet: read the examples)
- Fires on
- 0.28% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 54%
- python 25%
- chat 13%
- agent 5%
- worksheet 4%
Makes the model say
their import=?"." jo<|tool_call_end|>path
Makes it not say
newallndum excited buteres
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.96of fun.<|assistant_end|><|bos|>One day, a cat named Jazz went for a walk. J
-
story 3.92project.<|assistant_end|><|bos|>One day, a mighty big cat named Tom went for a walk. He
-
story 3.9day, a big dog named Max went for a walk with his
-
story 3.83.<|bos|>One day, a big, honest dog named Max went for a walk. He
-
story 3.77jungle.<|bos|>One day, a big, thick cat named Tom went for a walk. He
-
story 3.73<|bos|>One day, a boy named Tom and his old dog Spot went for a walk in the
-
story 3.79.<|assistant_end|><|bos|>One day, a small dog named Max went for a walk on a
-
story 3.749.<|assistant_end|><|bos|>One day, a dog named Max went for a jog in
-
story 3.69to add?<|assistant_end|><|bos|>One day, a friendly cat named Tom went for a walk. He
-
story 3.68.py`.<|assistant_end|><|bos|>One day, a small dog named Tim went for a walk. He
-
story 3.6705.<|assistant_end|><|bos|>One day, a cool cat named Sam went for a walk. He
-
story 3.654⏎[]⏎<|bos|>One day, a little dog named Tim went for a walk. He