Skip to content
mini-lab
Features of prelude-2

Feature #854

Fires on “ sum” (not labeled yet: read the examples)

Fires on
0.32% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 33%
  • story 26%
  • agent 15%
  • python 14%
  • chat 13%

Makes the model say

of summermen daysum r

Makes it not say

something years he And.⏎ ? ?

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 5.47
    a great adventure because of the special medicine.<|bos|>The sum of 5 and
  2. worksheet 5.37
    answer is 7.<|assistant_end|><|bos|>The sum of 27
  3. worksheet 5.32
    726 is 104550.<|bos|>The sum of 83
  4. worksheet 5.32
    equals 48048.⏎The sum of 1 and
  5. worksheet 5.26
    9227 is 77362.⏎The sum of 94
  6. worksheet 5.22
    9812 is 13782.⏎The sum of 30
  7. worksheet 5.2
    friend, and they all had lots of fun playing together.<|bos|>The sum of 42
  8. worksheet 5.2
    87, you get 55737.⏎The sum of 68
  9. worksheet 5.16
    3 + 4 = 87.⏎The sum of 9 and
  10. worksheet 5.06
    3586.⏎The sum of 24
  11. worksheet 5.04
    flip(s)` and `size(s)`.<|assistant_end|><|bos|>The sum of 96
  12. worksheet 5.03
    9184 is 75610.⏎The sum of 51