Feature #104
Fires on “ ste” (not labeled yet: read the examples)
- Fires on
- 2.30% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 72%
- agent 16%
- chat 8%
- python 2%
- worksheet 2%
Makes the model say
sers gonees thingsight townet
Makes it not say
+)`=**/*. pluscalculator<|user_end|> list Python
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.17gone!"⏎Tim had an idea. "Let's mix some new spicy food!" So,
-
story 4.1, the little train practiced every day. It tried hard to make more steam and go faster
-
story 3.97want to hold him?"⏎Ben looks at the bear. He likes bears. He nod
-
story 3.8, there was a creative spider named Sally. Sally loved to make pretty webs in the
-
story 3.78, in a big tree, there was a bee hive. Many bees lived there and
-
story 3.56enter. It was a big pool of water with amazing colored lights and a gar
-
story 3.54Tom and Lily were playing in their room. They liked to make funny shadows on the wall
-
story 3.51ed to the tournament and found plenty of mighty steel pieces that he
-
story 3.46to sleep. From that day on, Sally was never scared of monsters again.<|bos|>
-
story 3.41time, there was a new magic toy. The toy could shoot pretty lights. It was
-
story 3.4The airport was big and noisy. There were many people and planes.⏎At
-
chat 3.35of the tree to see