Feature #465
Fires on “ dream” (not labeled yet: read the examples)
- Fires on
- 1.24% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 48%
- story 39%
- chat 8%
- python 4%
- worksheet 1%
Makes the model say
inged of for thaty comed
Makes it not say
tests): outside ( nums branch It Many
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.01again tomorrow. Max and Tim hugged each other and went to sleep, dreaming of more fun
-
chat 3.86fast asleep. Tim had a big smile on his face, dreaming about playing in
-
story 3.77. He said, "I will lead you home, but you must promise to not play in
-
story 3.77And just like that, they both drifted off to sleep, dreaming of more fun
-
story 3.75his room was clean again. Wink smiled and went to sleep, dreaming about playing with
-
story 3.7At the end of the day, they went home and slept, dreaming of more fun
-
agent 3.69after.<|bos|><|system_start|>tools: edit, glob, grep, question, read, shell
-
agent 3.68after.<|bos|><|system_start|>tools: edit, glob, grep, question, read, shell
-
agent 3.63.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read, shell
-
agent 3.63.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read, shell
-
story 3.63her hand on the stove and it hurt. She cried and cried, wishing she had listened
-
agent 3.62.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read, shell