Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #421

Fires on “1” (not labeled yet: read the examples)

Fires on
0.61% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 54%
  • chat 29%
  • agent 13%
  • story 3%
  • python 1%

Makes the model say

Tom8 playxdef haveTimBen

Makes it not say

When tookcommand))itedOnce takingned

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.54
    56⏎77902 plus 71 equals 77973
  2. worksheet 3.54
    72.⏎19090 plus 2 is 19092
  3. worksheet 3.49
    0.⏎28896 plus 60 is 28956
  4. worksheet 3.48
    stickers.⏎29976 plus 11 is 29987
  5. worksheet 3.43
    ace.<|bos|>69932 plus 961 is 7089
  6. worksheet 3.41
    24 toys and found 99 more. Now Anna has 18723
  7. worksheet 3.35
    you add 14926 and 8, you get 1493
  8. worksheet 3.35
    12 books and found 88 more. Now Lily has 16600
  9. worksheet 3.34
    76957 and 12, you get 76969
  10. worksheet 3.34
    51 shells and found 526 more. Now Max has 4957
  11. worksheet 3.32
    ```<|assistant_end|><|bos|>17079 plus 28 equals 17107
  12. worksheet 3.32
    40.⏎3891 plus 26 is 3917