Feature #2244
Fires on โ.โ (not labeled yet: read the examples)
- Fires on
- 1.55% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 83%
- chat 14%
- agent 2%
- python 1%
- worksheet 0%
Makes the model say
Bug friend am``` So But unexpected Then
Makes it not say
โ<|bos|> alwaysnding everyone adds and
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.57saw a little bird. The bird was helpless and could not fly. "Mom, look
-
story 3.55sky. The bird thought, "I can relax on the cloud." The bird flew up
-
story 3.52Lily saw a magic ice-cream cone. It could shrink things! Lily asked the ice
-
story 3.49in a puddle. The puddle was too small for the fish to swim. Tim wanted to help
-
story 3.48words were too big. He felt hurt that he could not read it. He asked his dad
-
story 3.47tree. The tree was on the rail. The train could not go. The train was sad
-
chat 3.4Tom and Max did not get along. They would fight about the music. Tom wanted to listen
-
story 3.36animal felt very sad. He knew he needed help to fix his home. So, he went
-
story 3.36big for them to play with. They didn't know what to do. Sue's mom came
-
chat 3.35to burn the ancient tree. All the animals in the hole were scared. But then, something
-
story 3.34what was inside. She tried to open it, but it was stuck. She asked her friends
-
chat 3.32in its nose. It tried to stop it, but it could not. The jellyfish snee