Feature #1293
Fires on “ to” (not labeled yet: read the examples)
- Fires on
- 0.21% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 58%
- story 20%
- agent 12%
- chat 7%
- worksheet 3%
Makes the model say
py30]+5 `B
Makes it not say
ic`. this`,incrementidemo big
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.31and laughed. They played until the sun went down and it was time to go home.⏎
-
chat 1.94under a tree.<|assistant_end|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
-
story 1.93ball and had lots of fun. After a while, it was time to go home. Lily
-
story 1.88They have fun and make new friends. They sing until it's time to go home. They
-
story 1.87went back to his friends. They all played catch until it was time to go home.⏎
-
story 1.86new friend. They played with Quack until it was time to go home. They
-
story 1.86.⏎Lilly and Mary talked and played until it was time to go to bed.
-
chat 1.84calculator.<|assistant_end|><|user_start|>Goodbye!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
-
chat 1.81help you today?<|assistant_end|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
-
story 1.81⏎Lily and Ben hugged Bob and played with him until it was time to go inside.⏎
-
story 1.8laughed and barked, having lots of fun together. When it was time to go home, Lily
-
story 1.79They all smiled and continued to play in the park until it was time to go home.<|bos|>