Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #580

Fires on “ of” (not labeled yet: read the examples)

Fires on
0.14% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 58%
  • chat 25%
  • agent 10%
  • python 4%
  • story 2%

Makes the model say

their<|bos|> twinsom both `[ each moral

Makes it not say

": he I dragonloud best idea<|system_end|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.5
    26 is 104550.<|bos|>The sum of 83 and
  2. worksheet 4.49
    0 + 46 = 46.<|bos|>The sum of 6 and
  3. worksheet 4.46
    a great adventure because of the special medicine.<|bos|>The sum of 5 and
  4. worksheet 4.27
    582 = 57646.⏎The sum of 93 and
  5. worksheet 4.22
    65 = 129.<|bos|>What is the sum of 7 and
  6. worksheet 4.21
    466 = 92470.⏎The sum of 612
  7. worksheet 4.2
    0 = 88009.⏎What is the sum of 8 and
  8. worksheet 4.19
    5 and 1, you get 36.⏎The sum of 300
  9. worksheet 4.18
    _core.py⏎all tests passed⏎<|bos|>What is the sum of 735
  10. worksheet 4.18
    662 = 56832.⏎The sum of 0 and
  11. worksheet 4.15
    58 = 74973.⏎The sum of 95 and
  12. worksheet 4.15
    + 26 = 5480.⏎The sum of 917