Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2120

Fires on “ is” (not labeled yet: read the examples)

Fires on
0.32% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 35%
  • chat 28%
  • agent 18%
  • story 14%
  • python 5%

Makes the model say

that your the they you he his

Makes it not say

but "!"`. But,"()`.ur."But

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 5.42
    9.<|assistant_end|><|bos|>How much is 403
  2. worksheet 5.15
    rude, and they became good friends.<|assistant_end|><|bos|>How much is 1 +
  3. worksheet 4.96
    768 = 56774.⏎How much is 492
  4. worksheet 4.95
    3928 = 9787.⏎How much is 972
  5. worksheet 4.93
    754 = 15791.⏎How much is 1 +
  6. worksheet 4.78
    + 2 = 97861.⏎How much is 457
  7. chat 4.73
    a small and friendly assistant.<|system_end|><|user_start|>How much is 994
  8. chat 4.71
    some numbers to add?<|assistant_end|><|bos|><|user_start|>How much is 91 +
  9. worksheet 4.7
    8 + 7 = 2395.⏎How much is 920
  10. worksheet 4.66
    517 is 11302.⏎How much is 912
  11. worksheet 4.65
    Now Anna has 68210 balls.⏎How much is 84 +
  12. worksheet 4.63
    and 21 is 3300.<|bos|>How much is 329