Skip to content
mini-lab
Features of prelude-2

Feature #3904

Fires on “8” (not labeled yet: read the examples)

Fires on
0.31% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 79%
  • chat 15%
  • story 4%
  • agent 2%
  • python 0%

Makes the model say

prelude<|system_end|> acc course Now unexpected insidenewString

Makes it not say

addpyat([letter `[ver liked

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.58
    = 2539.⏎Can you add 68637 and
  2. worksheet 3.47
    = 6249.⏎Can you add 98848 and
  3. worksheet 3.47
    = 7076.⏎Can you add 72366 and
  4. worksheet 3.44
    5 is 183.⏎Can you add 6661 and 2
  5. worksheet 3.4
    45057.⏎Can you add 928 and 94
  6. worksheet 3.38
    equals 227.⏎If you add 20688 and 6
  7. worksheet 3.36
    = 3308.⏎Can you add 17894 and
  8. worksheet 3.35
    = 226.⏎If you add 2766 and 0,
  9. worksheet 3.35
    has 868 books.⏎Can you add 7875 and 6
  10. worksheet 3.34
    6 = 147.<|bos|>Can you add 480 and 47
  11. worksheet 3.33
    = 8488.⏎Can you add 58246 and
  12. worksheet 3.33
    = 8388.⏎Can you add 280 and 42