Feature #682
Fires on “ small” (not labeled yet: read the examples)
- Fires on
- 0.78% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 70%
- agent 12%
- chat 11%
- python 4%
- worksheet 4%
Makes the model say
, watch look door my Butupet
Makes it not say
<|assistant_end|>many kind passes$itedcalculatorSorry
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.83One day, he saw something strange inside the box. It was a small green ball. Tim
-
story 2.66⏎Mia opened the box and found a surprise inside. It was a small, incredible toy.
-
story 2.59coming from a bush nearby. He peeped in and saw a tiny kitten struggling
-
chat 2.54as they finished, something unexpected happened. A big, wet frog jumped
-
chat 2.54⏎Mia opened the box and found a surprise inside. It was a small, incredible toy.
-
story 2.53she noticed something attractive in the shadows. It was a small house with lots of
-
story 2.52. She was very happy. But then, something unexpected happened. A small mouse came out of
-
chat 2.48⏎Mia opened the box and found a surprise inside. It was a small, incredible toy.
-
story 2.39. Lily ran to answer it. She opened the door and saw a small cat outside.⏎
-
story 2.38Then, something strange happened. A big wind came and blew
-
story 2.37felt happy with his new rock friend.⏎Suddenly, Tim saw a small cat stuck in a
-
story 2.36a strange noise coming from behind her. She turned around and saw a big wolf!⏎The