Feature #328
Fires on “ big” (not labeled yet: read the examples)
- Fires on
- 1.02% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 61%
- chat 18%
- agent 16%
- python 4%
- worksheet 1%
Makes the model say
smile other smiles big new family smileddef
Makes it not say
with has' favorite lateient":test
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.65Lily knew her new watch was special. She went to bed with a big smile on her face
-
story 5.61her fancy towel back. She hugged it tight and went home with a big smile on her face
-
story 5.46They put the stone back in the box, and went home with a big smile, knowing they
-
story 5.06get back to the surface. She swam back to land with a big smile on her face
-
story 4.97and promised to come back soon. He started walking home, with a big smile on his face
-
chat 4.83by step or with a calculator.<|assistant_end|><|user_start|>
-
story 4.66, and Tim was not worried anymore. They all went home with a big smile.<|bos|><|user_start|>
-
agent 4.54function combine in core.py. It joins a and b with a space.<|user_end|><|assistant_start|>
-
story 4.53was happy that her doll could help her, and they went home with big smiles on their faces
-
story 4.5ites with a pen on paper.
-
chat 4.46or with a calculator.<|assistant_end|><|bos|>
-
story 4.42favorite books and felt happy. They sat down and read their books with big smiles on their faces