Feature #1769
Fires on “'t” (not labeled yet: read the examples)
- Fires on
- 1.07% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 77%
- agent 12%
- chat 8%
- python 2%
- worksheet 0%
Makes the model say
<|bos|> like afraid⏎ hug love her be
Makes it not say
2 TheymaxThey left them?lower
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.83felt sad and didn't want to play with
-
story 2.72got angry. It didn't like that the at
-
story 2.61was no grass left to eat. Sam was very sad. He didn't know what to do
-
story 2.57very excited.⏎As
-
chat 2.57very happy. She bought
-
story 2.57very happy. She sat
-
story 2.52sad and didn't know what to do
-
chat 2.49because of the big, smelly waste. They were sad and didn't know what to do
-
story 2.45the milk. It will be easy if we
-
story 2.42the chair. The baby felt confused and didn't understand why. But
-
story 2.34and dragged him home. He was angry and sad. He did not want to play with
-
story 2.27the water in his bowl turned to ice. Max was scared and did not know what to do