Skip to content
mini-lab
Features of prelude-2

Feature #1643

Fires on “ of” (not labeled yet: read the examples)

Fires on
1.13% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 43%
  • worksheet 28%
  • chat 16%
  • python 9%
  • story 5%

Makes the model say

expression{sreadOU enjoyedseTrue

Makes it not say

3Can9`PleasemdLet days

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.68
    2910.⏎Find the sum of 426
  2. worksheet 2.58
    416 is 416.⏎Find the sum of 3 and
  3. worksheet 2.56
    98 = 25350.⏎Find the sum of 269
  4. worksheet 2.5
    018.⏎Find the sum of 102
  5. worksheet 2.49
    2 = 84042.⏎Find the sum of 2 and
  6. worksheet 2.48
    6 + 19 = 25.⏎Find the sum of 7 and
  7. worksheet 2.47
    4 = 54306.⏎Find the sum of 48 and
  8. worksheet 2.45
    44 = 3414.⏎Find the sum of 216
  9. worksheet 2.43
    + 5 = 2183.⏎Find the sum of 34 and
  10. worksheet 2.43
    + 2 = 8756.<|bos|>Find the sum of 3 and
  11. worksheet 2.42
    89 = 67058.⏎Find the sum of 973
  12. worksheet 2.36
    // 2`. The tests pass now.<|assistant_end|><|bos|>Find the sum of 84 and