Skip to content
mini-lab
Features of prelude-2

Feature #2964

Fires on “ add” (not labeled yet: read the examples)

Fires on
0.59% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 38%
  • agent 22%
  • worksheet 17%
  • python 12%
  • story 10%

Makes the model say

_ addaladd numbersed(as

Makes it not say

utilsemohes askSCORES say branches False

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 5.02
    and 14 is 7749.⏎If you add 635
  2. worksheet 4.99
    and 649 is 654.⏎If you add 993
  3. worksheet 4.96
    3 is 568.⏎If you add 151
  4. worksheet 4.95
    being clumsy. And all his friends were happy too.<|bos|>If you add 490
  5. worksheet 4.88
    from scratch on a laptop by mini-lab.<|assistant_end|><|bos|>If you add 458
  6. worksheet 4.87
    had a new friend to play with in the park.<|bos|>If you add 259
  7. worksheet 4.86
    them were happy and laughing. What a great day!<|bos|>If you add 9 and
  8. worksheet 4.85
    53<|think_end|>The answer is 53.<|assistant_end|><|bos|>If you add 35 and
  9. worksheet 4.75
    so happy and thanked Tim's dad for his help.<|bos|>If you add 540
  10. worksheet 4.74
    6227 is 9003.⏎If you add 7 and
  11. worksheet 4.73
    45 + 9 = 654.⏎If you add 1 and
  12. worksheet 4.71
    the wet glass bottle and seeing the pretty glow.<|bos|>If you add 6 and