Feature #163
Fires on “.” (not labeled yet: read the examples)
- Fires on
- 1.39% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 80%
- chat 11%
- python 5%
- agent 2%
- worksheet 2%
Makes the model say
⏎ sum were," idea<|bos|>Hieter
Makes it not say
py Python bothell down enjoyed s"
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 8.11ing something very colorful. Tim was very curious and wanted to know more.⏎At the park
-
story 7.48big and bright. Kitty was very curious and wanted to play with it.⏎Kitty jumped and
-
story 7.37. Sue told Lily that she would save her money to buy the purse.⏎Each day
-
story 7.33cat was very pretty and soft. Tim wanted to play with the cat.⏎Tim got off
-
story 7.23The shore had sand and water. Tom liked to play on the shore.⏎Tom wanted to
-
chat 7.17The rich man had many pretty things. Tim wanted to be like him.⏎Tim said,
-
story 7.14ant about fun games. Lily wanted to teach the cat how to play.⏎Lily took a
-
story 7.14Fluffy in the sack and swing her around. Fluffy thought it was fun.⏎One day,
-
story 7.04cat was soft and cute. Sue was very happy to find the cat. She wanted to take
-
story 7.02ine. Max was curious and wanted to play with the wine too.⏎Max ran to
-
story 6.88town did not like the noisy dragon. They wanted him to be quiet.⏎One day,
-
story 6.87high in the sky. He liked to see the sun and the clouds.⏎One day,