Feature #653
Fires on “ day” (not labeled yet: read the examples)
- Fires on
- 0.79% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 75%
- chat 11%
- agent 10%
- worksheet 2%
- python 2%
Makes the model say
and new long<|bos|> ever r go while
Makes it not say
":() ideaked liked Now(-ren
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.69day, Tom went to
-
story 2.69day, pretending their
-
story 2.69day, the barber talked
-
story 2.69day, a boy named
-
story 2.69day and play all night
-
story 2.69day, Kitty heard a
-
story 2.69day, a little girl
-
story 2.69day, the monkey was
-
story 2.69day, Tim tasted a
-
story 2.69day, a big dog
-
story 2.69day on, the star
-
story 2.15sea. Every day, Bob would go