Skip to content
mini-lab
Features of prelude-2

Feature #3480

Fires on “+” (not labeled yet: read the examples)

Fires on
1.27% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 67%
  • chat 28%
  • agent 2%
  • story 1%
  • python 1%

Makes the model say

( %ings swam+_1 Now

Makes it not say

g birdx everyitems Mom mom he

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.98
    what's 409 plus 5?⏎409+005:
  2. chat 3.9
    : 5+7=12, 2⏎29+17:
  3. worksheet 3.88
    .⏎what is 557+3⏎557+003:
  4. worksheet 3.86
    project.<|assistant_end|><|bos|>645+9=⏎645+009:
  5. chat 3.85
    <|system_end|><|user_start|>what is 17+2<|user_end|><|assistant_start|><|think_start|>17+02:
  6. worksheet 3.85
    flowers. How many flowers does Sam have now?⏎366+005:
  7. chat 3.84
    <|system_end|><|user_start|>what is 15+6<|user_end|><|assistant_start|><|think_start|>15+06:
  8. worksheet 3.83
    what's 649 plus 8?⏎649+008:
  9. worksheet 3.82
    to know 377 + 1.⏎377+001:
  10. worksheet 3.79
    more toys. How many toys does Max have now?⏎33+01:
  11. worksheet 3.78
    359 and 28 for me?⏎359+028:
  12. worksheet 3.78
    toys. How many toys does Lily have now?⏎764+006: