Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3915

Fires on “3” (not labeled yet: read the examples)

Fires on
1.72% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 45%
  • chat 32%
  • agent 22%
  • story 1%
  • python 1%

Makes the model say

39485067

Makes it not say

rest idea<|assistant_start|>oldString()`]`":rite

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 6.01
    4 is 75610.⏎The sum of 5193 and
  2. worksheet 5.95
    adventure because of the special medicine.<|bos|>The sum of 5 and 64
  3. worksheet 5.94
    answer is 7.<|assistant_end|><|bos|>The sum of 2776 and
  4. worksheet 5.87
    36 = 9294.⏎The sum of 7 and 69
  5. worksheet 5.85
    The tests pass now.<|assistant_end|><|bos|>The sum of 3970 and
  6. worksheet 5.77
    6 = 92470.⏎The sum of 612 and
  7. worksheet 5.74
    is 104550.<|bos|>The sum of 83 and 0
  8. worksheet 5.73
    1, you get 36.⏎The sum of 300 and
  9. worksheet 5.71
    5 + 78 = 83⏎The sum of 88761
  10. worksheet 5.7
    3 + 4 = 87.⏎The sum of 9 and 76
  11. worksheet 5.69
    276 = 540.⏎The sum of 391 and
  12. worksheet 5.68
    73 = 9328.⏎The sum of 2377 and