Feature #3681
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.63% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 70%
- chat 22%
- agent 6%
- worksheet 1%
- python 1%
Makes the model say
noise animalsl sun kids red started bear
Makes it not say
fliphttps. upon list>>> or favorite
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.83Once upon a time, in a small town, there was a team of kids who liked to
-
story 2.76was mild. The pole was in the middle of a park where kids liked to play
-
story 2.69teacher who was very nice. The classroom was a regular place where kids could be happy
-
story 2.68<|bos|>One day, a little ball named B
-
story 2.63this project.<|assistant_end|><|bos|>Once upon a time, there was a gifted little girl named Amy
-
story 2.63answer is 537.<|assistant_end|><|bos|>One day, a lively girl named Mia found
-
story 2.6, there was a loud party in a big house. Lots of kids came to play
-
story 2.58a story, or some numbers to add?<|assistant_end|><|bos|>One day, a strong boy named Tom
-
story 2.56Lucy for making it look so pretty.<|bos|>One day, a little cat named
-
story 2.56should we do in this project?<|assistant_end|><|bos|>One day, a group of ants went on a
-
chat 2.54to go to a new place. He wanted to find a port where he could rest.
-
story 2.54, 968<|think_end|>968<|assistant_end|><|bos|>One day, a little plane was flying