Feature #2074
Fires on “ hard” (not labeled yet: read the examples)
- Fires on
- 0.75% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 60%
- agent 18%
- chat 12%
- worksheet 6%
- python 4%
Makes the model say
er work onen up in for red
Makes it not say
generator*<|user_start|>Created trained<|tool_start|>RenamedCreate
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.68best."⏎So, the little train practiced every day. It tried hard to make more ste
-
story 3.64in the square box, but it just wouldn't fit. She tried harder and harder
-
story 3.42thunder."⏎They started to nap, but the thunder got louder and louder
-
story 3.36onion wanted to join the race. The onion had legs and could run fast. The other r
-
story 3.19car named Speedy. Speedy loved to go fast. He would speed
-
story 3.15Once upon a time, there was a big storm. The wind blew hard, and the rain
-
chat 3.15, there was a little red car named Tommy. Tommy loved to drive fast on the road.
-
story 3.14his help.⏎But then, something unexpected happened. The wind blew hard, and the as
-
story 3.13tree. The little pine tree wanted to grow tall and rise high in the sky.
-
story 3.12!" Red liked the idea and they started the race. They flew high and low, fast
-
story 3.12. The friend told the bird, "You can fly! Just try harder!" The bird
-
chat 3.11. Tim loved to play with his red ball. He would throw it high up in the sky