Feature #156
Fires on “ be” (not labeled yet: read the examples)
- Fires on
- 0.04% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 61%
- chat 15%
- agent 13%
- python 9%
- worksheet 2%
Makes the model say
ning hur averageTrueGoodAnnaaverage its
Makes it not say
"()`fact anymore)`()] everywhere
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 1.41, 7]))⏎⏎$ python3 script.py⏎1⏎30
-
story 1.37is still a good boy, but he needs to listen and follow the rules. She
-
story 1.31his rope to play. He saw a big tree and thought it would be fun to swing on
-
story 1.3excited to play outside. He saw a big tree and thought it would be fun to run around
-
story 1.3an icy hill and wanted to slide down it. Tim thought it would be fun to slide on
-
story 1.27day, Zoomy saw an enormous hill. He thought it would be fun to zoom down
-
story 1.25Fin lived in a beautiful reef with his family. The reef was full of
-
python 1.23, 4, 4, 1, 5])⏎15⏎<|bos|><|system_start|>
-
python 1.237, 4, 6, 0, 6])⏎23⏎<|bos|>
-
chat 1.23and wanted to go for a swim. It flew away and soon stopped above a lake.
-
story 1.22thought and thought. Then,
-
story 1.21was amazed that everyone was cheering for her plane! Jane smiled from ear to ear as she