Feature #484
Fires on “,” (not labeled yet: read the examples)
- Fires on
- 0.55% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 85%
- chat 10%
- agent 4%
- python 1%
- worksheet 0%
Makes the model say
something one other it their they the a
Makes it not say
didn did forgot liked:us wasth
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.02happy. They played with the fixed toy all day.⏎But then, something unexpected happened.
-
story 4.97was still alert. Then, the rabbit heard a
-
story 4.93sad and didn't know what to do. But then, the dog came back
-
story 4.91could not find it. Tom and Sue were very sad.⏎Then, a big wave came
-
story 4.89Tim was happy to have a new friend.⏎But then, the sky turned dark
-
story 4.86the toy anywhere. The little bird started to cry.⏎Then, the unique crocodile had
-
story 4.85it. He was very happy.⏎Then, Spot saw a boy
-
story 4.72, feeling much less worried.<|bos|>Billy was playing with his sack when his dad walked up
-
story 4.68were playing with the basketball. They were very happy. But then, something unexpected happened.
-
story 4.66together. They were very happy.⏎But then, something unexpected happened.
-
story 4.63there was a little boy named Sam. He was walking around his garden when he noticed something strange
-
chat 4.62. She felt sad. Then, she closed her eyes