Skip to content
mini-lab
Features of prelude-2

Feature #1572

Fires on “1” (not labeled yet: read the examples)

Fires on
0.64% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 76%
  • chat 21%
  • story 1%
  • agent 1%
  • python 1%

Makes the model say

7356es04 greeting

Makes it not say

`https Come("_[::-:Fix

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 5.59
    9.⏎If you add 66972 and 19, you get
  2. worksheet 5.5
    .<|assistant_end|><|bos|>If you add 76957 and 12, you get
  3. worksheet 5.49
    26.⏎If you add 9238 and 211, you
  4. worksheet 5.26
    960.⏎Add 12742 and 188.⏎
  5. worksheet 5.24
    5.⏎If you add 11553 and 3870,
  6. worksheet 5.24
    97.⏎If you add 8129 and 52446
  7. worksheet 5.21
    ⏎If you add 47536 and 8, you get
  8. worksheet 5.16
    6.⏎If you add 44764 and 2, you get
  9. worksheet 5.08
    4.⏎Tim had 3946 flowers and found 31929
  10. worksheet 5.06
    99.⏎If you add 9674 and 350, you
  11. worksheet 5.02
    2.<|assistant_end|><|bos|>If you add 8569 and 7673,
  12. worksheet 5.02
    69.⏎Lucy had 298 books and found 5 more. Now Lucy