Feature #1214
Fires on “,” (not labeled yet: read the examples)
- Fires on
- 0.52% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 87%
- story 11%
- chat 1%
- python 0%
- worksheet 0%
Makes the model say
and,'s sk```as`One
Makes it not say
i adds)`.aking<|think_start|> timetxtfe
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.37the furniture. She danced on the chair, the table, and even the bed
-
story 4.36the park with her mom. She played on the swings, the slide, and the see-
-
story 4.2play with clay. She had many colors of clay like red, blue, and yellow. Lily
-
story 3.93favorite toy, a long staff. He would run, jump, and bow to the
-
story 3.81. They made a picture of a house, a tree, a dog, and a sun.
-
agent 3.76, webfetch, websearch, write, execute
-
story 3.75. Lucy liked to taste new things. She would taste fruits, vegetables, and even flowers.
-
agent 3.73, webfetch, websearch, write, execute
-
agent 3.72, webfetch, websearch, write, execute
-
agent 3.7, webfetch, websearch, write, execute
-
story 3.68to sort her toys. She had many different toys: dolls, cars, and blocks. One
-
agent 3.68, webfetch, websearch, write, execute