Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1753

Fires on “8” (not labeled yet: read the examples)

Fires on
0.78% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 41%
  • worksheet 36%
  • agent 18%
  • story 4%
  • python 1%

Makes the model say

ainid)y alone'ag places

Makes it not say

defloweriss Thank<|bos|> Theybox

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.06
    get 11.⏎I need to know 61349 + 3
  2. worksheet 2.92
    702.⏎I need to know 27161 + 34
  3. worksheet 2.84
    1635.⏎I need to know 5418 + 99
  4. worksheet 2.83
    9891.⏎I need to know 4525 + 44
  5. worksheet 2.82
    8224.⏎I need to know 6778 + 27
  6. worksheet 2.79
    = 37.⏎I need to know 5357 + 48
  7. worksheet 2.78
    03 books.⏎I need to know 75441 + 47
  8. worksheet 2.76
    5158.⏎I need to know 5028 + 92
  9. worksheet 2.76
    3919.⏎I need to know 5673 + 27
  10. worksheet 2.74
    10.⏎Could you tell me what 22572 + 39
  11. worksheet 2.65
    376 balls.⏎I need to know 9688 + 68
  12. worksheet 2.65
    ake a cake.<|assistant_end|><|bos|>I need to know 5268 + 53