Feature #2529
Fires on “ inside” (not labeled yet: read the examples)
- Fires on
- 0.20% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 86%
- chat 9%
- agent 4%
- worksheet 1%
- python 0%
Makes the model say
. of, where it_ and!
Makes it not say
content<|assistant_end|>e calculatornvariteate
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.45teddy bear that she loved very much. She took the teddy bear with her everywhere she went.
-
story 4.45thick cardboard box in her room. She did not know what was inside, so she decided
-
story 4.22little dog named Max found a big box. The box had a surprise inside. Max was very
-
story 4.11was so excited. It was a big box with a lot of things inside. Pete
-
story 4.07went to a new house. Tom had a box with all his toys inside. He wanted to
-
story 3.94very excited.⏎Max opened the chest and found many fun toys inside. He took out
-
story 3.9, brown box. They opened the box and found lots of yummy food inside. They were so
-
story 3.89little girl named Lucy found a small box. The box had a secret inside. She wanted to
-
story 3.86the shadows. It was a small house with lots of interesting things inside. She felt like
-
story 3.85It was soft and had pretty colors. Amy took her fancy towel with her everywhere she went.
-
story 3.83day, Tim found a magazine. It had many colorful pictures inside. Tim was very
-
story 3.77with a big knob on it. She did not know what was inside the box. Lily