Feature #4065
Fires on “,” (not labeled yet: read the examples)
- Fires on
- 0.74% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 76%
- chat 18%
- agent 3%
- python 2%
- worksheet 0%
Makes the model say
a projecttnums theopencode voice man
Makes it not say
estNoBe!veredLook sheo
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.97<|bos|>One day, a little ball named
-
story 3.69`items.py`, line 1.<|assistant_end|><|bos|>One sunny day, a little girl named
-
story 3.68Now Lucy has 11626 toys.<|bos|>One day, a smart girl named
-
story 3.63Lucy for making it look so pretty.<|bos|>One day, a little cat named
-
story 3.61they found the big, shiny balloon in the tree.<|bos|>One day, a little boy named
-
story 3.682347 apples.<|bos|>One day, a little girl named
-
story 3.58+ 73 = 82.<|bos|>One day, a little girl named
-
story 3.58Hi! How can I help with your code?<|assistant_end|><|bos|>One day, Tim and his mom
-
story 3.57843.<|assistant_end|><|bos|>One day, a boy named Tim
-
story 3.54Hi! What should we do in this project?<|assistant_end|><|bos|>One day, a group of ants
-
story 3.53to be more careful with his toy weapon.<|bos|>One day, a cat named B
-
story 3.49like a story, or some numbers to add?<|assistant_end|><|bos|>One day, a strong boy named