Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2011

Fires on “ ” (not labeled yet: read the examples)

Fires on
1.65% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 50%
  • chat 30%
  • python 16%
  • agent 3%
  • story 1%

Makes the model say

68749531

Makes it not say

up fit<|assistant_end|> with froming: adventure

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 10.48
    9 = 10564.⏎Hey, what's 2819
  2. worksheet 10.27
    252 = 261.⏎Hey, what's 4 plus 4
  3. worksheet 10.22
    1 = 109878.⏎Calculate 576 +
  4. worksheet 10.13
    73 = 8880.⏎Hey, what's 4 plus 2
  5. worksheet 10.11
    735 = 1534.⏎38 plus 145 is
  6. worksheet 9.98
    063 = 9101.⏎11 plus 10 equals
  7. worksheet 9.95
    4 + 0 = 274.⏎51 plus 91 equals
  8. worksheet 9.95
    = 171.⏎45 plus 55 is
  9. worksheet 9.88
    536 is 1545.⏎69 plus 64 is
  10. worksheet 9.88
    = 1316.⏎Ben had 9 books and found
  11. worksheet 9.88
    67 = 70119.⏎47 plus 3544
  12. worksheet 9.86
    94 = 94514.⏎83 plus 1 equals 8