Feature #1406
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.13% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 70%
- chat 13%
- agent 11%
- worksheet 4%
- python 2%
Makes the model say
promise work happenedhe ==Gc this
Makes it not say
Addeditalitems plus python")) addscalculator
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 2.71story about a cat!<|user_end|><|assistant_start|>One day, a big cat and a little dog were playing
-
story 2.68en and then seek me." Ben says, "OK. One, two, three..."
-
story 2.65They count the blocks as they add them. "One, two, three, four, five
-
story 2.53.py⏎all tests passed⏎<|bos|>One day, a cat and a dog went to play
-
story 2.5was very excited and started to count right away. He counted one, two, three, four
-
story 2.47Eleven, twelve, one, two, three, four, five, s
-
story 2.42together at the park every day.<|bos|>One day, a cat and a dog were playing with
-
chat 2.42Write a story for me.<|user_end|><|assistant_start|>One day, a cat and a dog were walking.
-
story 2.41stairs. She counted them as she went. One, two, three, four, five
-
story 2.39a little bit. On the count of three. One, two, three!"⏎Sara and
-
story 2.38named Ben.⏎Spot
-
story 2.38named Tom. Tom loved