Feature #2142
Fires on “ of” (not labeled yet: read the examples)
- Fires on
- 0.49% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 44%
- story 22%
- worksheet 15%
- chat 13%
- python 6%
Makes the model say
54 happy looked we9 sad low
Makes it not say
)⏎ `rite testultipl there So
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.27welcome, Mia." They played with the toy car together and had lots of fun.<|bos|>7
-
story 2.2decided to give the ball to Tim. They played together and had lots of fun.⏎After
-
story 2.18Bear! You are incredible!" They played with the ball and had lots of fun. From that
-
story 1.97, I want to be your friend!" They played together and had lots of fun.⏎Soon
-
story 1.89"You're so silly, Spot!" They played together and had lots of fun.<|bos|><|user_start|>
-
story 1.87."⏎Sue played with the whistle all day, and they had lots of fun. But when
-
story 1.86toy inside.⏎Tim and Sue played with the toy and had lots of fun. They were
-
story 1.85swam with the fish every day. They all played together and had lots of fun. And they
-
story 1.83tape." They both played with the tape together, and they had lots of fun. From that
-
agent 1.83py`, `test_calc.py` and `test_listlib.py`.<|assistant_end|><|bos|>
-
story 1.83<|bos|>Once upon a time there was a boy named Billy. He was 3 years old and
-
story 1.79They took turns swinging on the vine. They were having lots of fun. Then,