Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1408

Fires on “ ” (not labeled yet: read the examples)

Fires on
2.26% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 66%
  • chat 31%
  • agent 2%
  • story 1%
  • python 1%

Makes the model say

0 alone+4 armSo<|tool_call_start|>

Makes it not say

: Python<|assistant_end|>` kitcheni upon import

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 9.59
    + 62486 = 1443
  2. worksheet 9.44
    The sum of 29 and 75899 is 7592
  3. worksheet 9.27
    The sum of 61 and 93008 is 9306
  4. worksheet 9.21
    The sum of 13 and 45864 is 4587
  5. worksheet 9.1
    + 18559 = 1859
  6. worksheet 9.07
    The sum of 97 and 27853 is 2795
  7. worksheet 9.0
    py`.<|assistant_end|><|bos|>57 plus 59600 is 5965
  8. worksheet 8.94
    apples and found 66647 more. Now Lily has 6671
  9. worksheet 8.93
    + 15834 = 7853
  10. worksheet 8.86
    080⏎39 plus 54179 equals 5421
  11. worksheet 8.77
    The sum of 89 and 67985 is 6807
  12. worksheet 8.77
    ⏎The sum of 2 and 69817 is 6981