Skip to content
mini-lab
Features of prelude-2

Feature #2685

Fires on “ the” (not labeled yet: read the examples)

Fires on
0.16% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 57%
  • chat 24%
  • python 8%
  • story 7%
  • agent 5%

Makes the model say

plus of who Tim knockedose The sum

Makes it not say

So False done been sorry happeneditist

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.94
    321 + 5 = 326.⏎Find the sum of 9
  2. worksheet 4.71
    78 + 5 = 2183.⏎Find the sum of 3
  3. worksheet 4.52
    416 is 416.⏎Find the sum of 3
  4. worksheet 4.46
    9153 is 9199.⏎Find the sum of 6
  5. worksheet 4.45
    6189 = 67058.⏎Find the sum of 9
  6. worksheet 4.41
    0 + 44 = 3414.⏎Find the sum of 2
  7. worksheet 4.35
    4498 = 25350.⏎Find the sum of 2
  8. worksheet 4.29
    So 6 + 19 = 25.⏎Find the sum of 7
  9. worksheet 4.28
    0 + 2 = 84042.⏎Find the sum of 2
  10. worksheet 4.26
    95 + 92 = 187.⏎Find the sum of 6
  11. worksheet 4.19
    <|bos|>2 + 455 = 457⏎Find the sum of 1
  12. worksheet 4.13
    5 and 57, you get 62.⏎Find the sum of 3