Skip to content
mini-lab
Features of prelude-2

Feature #1877

Fires on “The” (not labeled yet: read the examples)

Fires on
0.35% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 39%
  • story 28%
  • worksheet 27%
  • chat 5%
  • python 1%

Makes the model say

next answerir sumwSo,"head

Makes it not say

ER " town happily python found JackMIT

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.43
    499 + 85 = 584.⏎The sum of 6
  2. worksheet 4.42
    + 8336 = 9294.⏎The sum of 7
  3. worksheet 4.42
    So 98 + 5 = 103.⏎The sum of 9
  4. worksheet 4.41
    5 + 58 = 74973.⏎The sum of 9
  5. worksheet 4.4
    + 4293 = 4417.⏎The sum of 7
  6. worksheet 4.36
    9 + 491 = 7300.⏎The sum of 2
  7. worksheet 4.34
    4 more. Now Tim has 5962 stars.⏎The sum of 1
  8. worksheet 4.34
    3 + 4 = 87.⏎The sum of 9
  9. worksheet 4.34
    10017 = 10087.⏎The sum of 7
  10. worksheet 4.31
    92466 = 92470.⏎The sum of 6
  11. worksheet 4.31
    187, you get 55737.⏎The sum of 6
  12. worksheet 4.31
    64 + 276 = 540.⏎The sum of 3