Feature #1877
Fires on “The” (not labeled yet: read the examples)
- Fires on
- 0.35% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 39%
- story 28%
- worksheet 27%
- chat 5%
- python 1%
Makes the model say
next answerir sumwSo,"head
Makes it not say
ER " town happily python found JackMIT
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 4.43499 + 85 = 584.⏎The sum of 6
-
worksheet 4.42+ 8336 = 9294.⏎The sum of 7
-
worksheet 4.42So 98 + 5 = 103.⏎The sum of 9
-
worksheet 4.415 + 58 = 74973.⏎The sum of 9
-
worksheet 4.4+ 4293 = 4417.⏎The sum of 7
-
worksheet 4.369 + 491 = 7300.⏎The sum of 2
-
worksheet 4.344 more. Now Tim has 5962 stars.⏎The sum of 1
-
worksheet 4.343 + 4 = 87.⏎The sum of 9
-
worksheet 4.3410017 = 10087.⏎The sum of 7
-
worksheet 4.3192466 = 92470.⏎The sum of 6
-
worksheet 4.31187, you get 55737.⏎The sum of 6
-
worksheet 4.3164 + 276 = 540.⏎The sum of 3