Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3414

Fires on “5” (not labeled yet: read the examples)

Fires on
0.48% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 79%
  • chat 9%
  • story 7%
  • python 3%
  • agent 3%

Makes the model say

o6 many0 test7 no full

Makes it not say

Onceag ever: %):'rev

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 7.81
    zoo.<|assistant_end|><|bos|>7 plus 44311 equals 44318
  2. worksheet 7.73
    98 and 96227, you get 96325
  3. worksheet 7.64
    `.<|assistant_end|><|bos|>9 plus 69311 equals 69320.
  4. worksheet 7.53
    add 9 and 55203, you get 55212
  5. worksheet 7.5
    add 7 and 37648, you get 37655
  6. worksheet 7.49
    ⏎The sum of 9 and 7633 is 7642.
  7. worksheet 7.4
    sum of 97 and 72341 is 72438
  8. worksheet 7.31
    80⏎39 plus 54179 equals 54218
  9. worksheet 7.22
    you add 9 and 7419, you get 7428.
  10. worksheet 7.18
    6.⏎77 plus 82255 is 82332
  11. worksheet 7.13
    ⏎The sum of 7 and 6922 is 6929.
  12. worksheet 7.12
    you add 3 and 5540, you get 5543.