Skip to content
mini-lab
Features of prelude-2

Feature #1508

Fires on “ +” (not labeled yet: read the examples)

Fires on
0.36% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 66%
  • chat 17%
  • agent 8%
  • python 4%
  • story 4%

Makes the model say

([ prelude Soon defined't files sang file

Makes it not say

very great example import a cut`. p

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.79
    rich is not always about having a big house.<|bos|>Calculate 2 + 4.⏎
  2. worksheet 2.73
    24 = 120.⏎What's 1 + 406
  3. worksheet 2.67
    4 + 78 = 82.⏎Calculate 6 + 9.⏎
  4. chat 2.67
    use the calculator.<|system_end|><|user_start|>Calculate 2 + 892
  5. worksheet 2.66
    , you get 6993.⏎What's 4 + 399
  6. chat 2.66
    4, 40<|think_end|>40<|assistant_end|><|bos|><|user_start|>Calculate 2 + 1.<|user_end|>
  7. chat 2.64
    to be a new friend for Sue.<|bos|><|user_start|>What's 2 + 5?<|user_end|>
  8. worksheet 2.62
    37 = 14201.⏎Calculate 2 + 43.
  9. chat 2.62
    dreaming of more fun days to come.<|bos|><|user_start|>Calculate 1 + 497
  10. worksheet 2.62
    , and they became good friends.<|assistant_end|><|bos|>How much is 1 + 415
  11. chat 2.61
    calculator<|system_end|><|system_start|>Do not use the calculator.<|system_end|><|user_start|>Calculate 3 + 0.<|user_end|>
  12. worksheet 2.61
    So 5 + 7 =