Feature #847
Fires on “One” (not labeled yet: read the examples)
- Fires on
- 0.92% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 74%
- chat 20%
- agent 4%
- python 1%
- worksheet 1%
Makes the model say
day time little today corner!"." alone
Makes it not say
se "path their the#vedct
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 7.72a gray rabbit. The rabbit was very enthusiastic. Every day it would hop
-
story 7.44when she went exploring.<|bos|>One day, a little
-
story 7.4a little boy. He was so curious and liked to guess things. One day he was walking
-
story 7.38was a girl. She was so calm and still like a lake. Every day she would go
-
story 7.22things and to be more careful with his toy weapon.<|bos|>One day, a cat
-
story 7.19Lucy for making it look so pretty.<|bos|>One day, a little
-
story 7.17was a bald lady. She was always nice to everyone she met. Every day, Mandy
-
story 7.16called Lily. She was three years old and loved to play outside. One day she asked her
-
story 7.13liked to rush. She always wanted to go really fast.⏎One day she got to
-
story 7.12was 3 years old and he loved to play with his friends. One day, Ben and
-
story 7.1<|bos|>One day, a little
-
story 7.1was a playful little girl and she loved to throw things.⏎One day, Mary