Feature #57
Fires on “ sum” (not labeled yet: read the examples)
- Fires on
- 0.22% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 33%
- worksheet 27%
- story 21%
- agent 16%
- python 3%
Makes the model say
prelude <script function⏎ typocalculator{
Makes it not say
to girl know9<|bos|>8 test,
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.26a small dog were playing. The big cat said, "I am tired." He let out
-
story 2.06was very happy.⏎After a while, the monkey began to feel tired. He let out
-
worksheet 1.99726 is 104550.<|bos|>The sum of 83
-
worksheet 1.94173 = 9328.⏎The sum of 23
-
story 1.91and jumped in the park.⏎After playing, Max and Sam were tired. They sat under
-
worksheet 1.93 + 4 = 87.⏎The sum of 9 and
-
worksheet 1.88371 = 18415.⏎The sum of 13
-
story 1.87to have a new friend.⏎After a while, they are all tired. They sit on
-
worksheet 1.859184 is 75610.⏎The sum of 51
-
worksheet 1.850017 = 10087.⏎The sum of 72
-
story 1.84and jumped and had lots of fun. After playing, they all felt tired. Spot's mom
-
worksheet 1.8287, you get 55737.⏎The sum of 68