Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1137

Fires on “ ” (not labeled yet: read the examples)

Fires on
1.19% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 59%
  • chat 23%
  • agent 12%
  • python 4%
  • story 2%

Makes the model say

_ ` rever there")⏎⏎ lower

Makes it not say

hungry c eat aboutine kitchen0 be

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.26
    .⏎The sum of 43 and 530 is 573.
  2. worksheet 4.24
    1718.⏎49 plus 530 is 579.
  3. worksheet 4.21
    97⏎So 91 + 206 = 297.
  4. worksheet 4.14
    If you add 402 and 49, you get 451.
  5. worksheet 4.07
    is 21.<|assistant_end|><|bos|>15 plus 44 equals 59.⏎
  6. worksheet 4.04
    ⏎So 75 + 340 = 415.
  7. worksheet 4.02
    112226.⏎4 plus 33 is 37.⏎
  8. worksheet 3.97
    44.⏎603 plus 354 equals 957.
  9. worksheet 3.95
    you add 490 and 744, you get 1234
  10. worksheet 3.93
    76 plus 430 equals 506.
  11. worksheet 3.92
    sum of 9449 and 7433 is 1688
  12. worksheet 3.9
    5.⏎2365 plus 9487 equals 1185