Skip to content
mini-lab
Features of prelude-2

Feature #506

Fires on “7” (not labeled yet: read the examples)

Fires on
0.77% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 79%
  • agent 16%
  • chat 3%
  • story 2%
  • python 1%

Makes the model say

or+ togetherSet plus prelude + want

Makes it not say

61270384

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 5.73
    9787.⏎How much is 97207 + 93
  2. worksheet 5.69
    5833.⏎If you add 83926 and 65
  3. worksheet 5.67
    42607.⏎Add 96122 and 47
  4. worksheet 5.61
    686.⏎I need to know 93364 + 91
  5. worksheet 5.58
    654.⏎If you add 99362 and 45
  6. worksheet 5.5
    , just like Ella the great big elephant.<|bos|>74300+605
  7. worksheet 5.45
    5465.⏎If you add 83817 and 73
  8. worksheet 5.43
    garden, feeling much safer.<|bos|>Calculate 97677 + 37
  9. worksheet 5.35
    499.⏎I need to know 87764 + 46
  10. worksheet 5.31
    py`, line 5.<|assistant_end|><|bos|>Calculate 59178 + 19
  11. worksheet 5.28
    31171.⏎What is 94953 plus 94
  12. worksheet 5.27
    ⏎If you add 47536 and 8,