Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #257

Fires on “3” (not labeled yet: read the examples)

Fires on
1.12% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 63%
  • chat 15%
  • agent 12%
  • python 6%
  • story 4%

Makes the model say

alls tests now `caseitems spot

Makes it not say

ve],head Oneing others OpenCodeab

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.13
    5325.⏎80193 plus 50334
  2. worksheet 2.13
    you get 25.⏎47082 plus 3875 equals
  3. worksheet 2.13
    55679.⏎1125 plus 51142
  4. worksheet 2.13
    99384.⏎40059 plus 3611 equals
  5. worksheet 2.12
    69722.⏎13007 plus 34739
  6. worksheet 2.11
    57023.⏎77290 plus 8 is 77
  7. worksheet 2.11
    71153.⏎27080 plus 23431
  8. worksheet 2.08
    7.⏎The sum of 53726 and 30 is 5
  9. worksheet 2.07
    0.⏎The sum of 28414 and 306 is
  10. worksheet 2.04
    ```<|assistant_end|><|bos|>17079 plus 28 equals 1
  11. worksheet 2.01
    = 1556⏎77902 plus 71 equals 7
  12. worksheet 2.01
    02042.⏎93823 plus 67 is 9