Feature #40
Fires on “ it” (not labeled yet: read the examples)
- Fires on
- 0.59% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 84%
- chat 12%
- agent 3%
- worksheet 1%
- python 0%
Makes the model say
could was would might will there is can
Makes it not say
<|tool_call_end|> preludeAddedprint daysHi<|system_end|>double
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 4.91One day, Tom decided to hide the music from Max. He thought this would make Max happy
-
story 4.72very fast. The big, scary bird saw Max's tail and thought it was a toy.
-
story 4.7near the big machine. The little girl saw the cane and thought it was important.⏎
-
story 4.64people in her village. She asked her parents for help and they thought it was a great plan
-
chat 4.59One day, Tom decided to hide the music from Max. He thought this would make Max happy
-
story 4.57. They played hide and seek. Remy remembered the big hole and thought it was a good place
-
story 4.49thought it was so funny that
-
story 4.41. They also threw some ice cubes at each other. They thought it was a great game
-
story 4.39Soon, Tim's friends saw him playing with the rock. They thought it was fun, too
-
story 4.38Sue decided to show the copper to her friends. They all thought it was very cool.
-
story 4.35him. Sam came and Tim showed Sam the icy hill. Sam thought it was a good idea
-
chat 4.33him.⏎Spot saw the big surf near the water. He thought it looked fun. Spot