Feature #292
Fires on “ r” (not labeled yet: read the examples)
- Fires on
- 0.55% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 78%
- chat 12%
- agent 9%
- python 2%
- worksheet 0%
Makes the model say
r sh dpy todayked toow
Makes it not say
how upon[- where moral<|tool_call_start|>]`. They
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.23<|bos|>Once upon a time there was a little girl. She liked to rush. She always
-
story 4.13became the friendliest taxi driver in town. Everyone loved riding in Tom
-
story 3.92down in the grass and closed his eyes. Suddenly, he heard something rustling in the
-
story 3.86. And he soared high in the sky, with Squeaky riding on his
-
chat 3.85sun was shining, and they were having fun.⏎While they were racing, a
-
story 3.82the mouse found another hole, much bigger than the other one. She rushed inside and
-
story 3.78have a message too, so he hopped into the boat and started rowing. He
-
story 3.74was still there. This time, she noticed the bug was trying to rise up and reach
-
story 3.7the dishwasher. Tim was so excited!⏎Tim would rush to pick up
-
story 3.69⏎One day, Fluffy said, "Spot, be careful when you rush on the r
-
story 3.69that Mom had bought for them. They were white and shiny and had ribbons.
-
story 3.67, laughing and having fun.⏎One sunny day, while Tim was riding his bike