Feature #213
Fires on “ always” (not labeled yet: read the examples)
- Fires on
- 0.36% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 68%
- agent 19%
- chat 10%
- python 2%
- worksheet 0%
Makes the model say
example helpingFinally edit running always<|arg|> sometimes
Makes it not say
smalls_ sum called + if smaller
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.93a boy named Joe. He was jolly, loved to play and was always having fun. One
-
story 3.694.<|bos|>Mandy was a bald lady. She was always nice to everyone she
-
story 3.56always remembered his big adventure
-
story 3.53there was a little girl named Lucy. Lucy was a dependable girl who always kept her promises
-
story 3.44there was a little boy who loved to go on adventures. He was always on the lookout
-
story 3.43a little boy called Jack. He was three years old and he was always getting into silly trouble
-
story 3.32but he was always careful to stay behind
-
story 3.3, there was a nosy little bird. He had four wings and was always asking questions. One
-
chat 3.25Once upon a time there was a little girl named Lucy. She was always curious and loved to
-
story 3.23, always looking for new fun
-
story 3.22loved riding in Tom's taxi, and he was always happy to help.
-
story 3.2was on a street. Max was a very frustrated dog because he was always dirty. He wanted