Feature #1360
Fires on “ idea” (not labeled yet: read the examples)
- Fires on
- 2.20% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 76%
- chat 10%
- agent 7%
- python 5%
- worksheet 2%
Makes the model say
again from withhow fast *join alone
Makes it not say
lived One openedut numsMIT likedOne
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.19One day, Ben was playing with his best friend
-
story 2.84to fly and play all day.⏎One day, Blue had an idea. He said to
-
story 2.84before. That's when she realized that something was wrong - she was in a very serious sit
-
story 2.81⏎Poppy thought for a moment and had an idea. She found another
-
story 2.81pond, it saw a big rock. The insect had an idea. It could stand
-
story 2.81sat alone, feeling regretful.⏎Suddenly, he had an idea.⏎He found
-
story 2.79day. One day, he saw a distant hill and had an idea. He wanted to
-
story 2.79he thought and he thought some more. Suddenly, Pat had an idea - he would bring
-
story 2.76he thought and he thought some more. Suddenly, Pat had an idea - he would bring
-
story 2.73with his toys and equipment. One sunny day, Tim was playing with his toy truck
-
story 2.73scared of everything. One day, Chicky was playing with her friends in
-
chat 2.73was blue and had a thick shirt. He was going to school. He