Feature #3106
Fires on “ water” (not labeled yet: read the examples)
- Fires on
- 0.85% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 61%
- agent 32%
- chat 5%
- python 1%
- worksheet 0%
Makes the model say
s and, fored from to who
Makes it not say
+<|assistant_end|>number]))=**/*.plus$value
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.83splash in the water. They saw many things in the water, like fish and shells and se
-
story 4.81splash in the water. They saw many things in the sea, like fish, crabs and
-
story 4.0, Spot, and their cat, Fluffy. She gave them food, water, and hugs every
-
story 3.96went to the zoo with their mom. They saw many animals, like lions, monkeys
-
story 3.87and soft and liked to play with her. Lily gave him food and water and toys and hugs
-
story 3.66play in the attic. They found many old things there, like toys and books and clothes
-
story 3.5have a big box with many things they find. They have rocks, shells, feathers,
-
story 3.47liked to play with their toys. They had many vehicles, like cars, trucks, bus
-
story 3.43many things, like big trees and little bugs.
-
story 3.4They liked to collect things from the park. They collected rocks, leaves, bugs and feather
-
story 3.39to observe things. They observe birds, flowers, bugs, and
-
story 3.33to the shore with his mom and dad. The shore had sand and water. Tom liked to