Feature #4
Fires on “ ground” (not labeled yet: read the examples)
- Fires on
- 0.25% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 80%
- chat 7%
- worksheet 5%
- agent 5%
- python 3%
Makes the model say
next one justwords two frontO barked
Makes it not say
subtractxschema⏎ boatreturnood idea
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.82ball and having fun. Suddenly, he saw a big sausage on the ground!⏎He went
-
story 4.79key. They looked around and saw a shiny metal thing on the ground. It was a
-
story 4.65.⏎As Lily walked, she found a pretty tea cup on the ground. She picked it
-
story 4.65too thin. Then, she saw a big, strong stick on the ground. Lucy picked it
-
story 4.56the garden. One day, Kitty saw a newspaper on the ground. She was curious
-
story 4.55named Max went for a walk. He saw a square box on the ground. Max was curious
-
story 4.55⏎As Tim was flying, he saw an ashtray on the ground. He thought it
-
story 4.54things to eat.⏎Bob found a big, round pear on the ground. He was so
-
story 4.53outside to play. She saw a big puddle on the ground. The puddle was
-
story 4.5garden, having fun. But then, Lily saw something shiny on the ground. It was a
-
story 4.5.⏎In the park, Tim saw a hard twig on the ground. He picked it
-
story 4.49.⏎One day they were outside and noticed a big blanket on the ground. They found out