Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #38

Fires on “ much” (not labeled yet: read the examples)

Fires on
1.89% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 59%
  • worksheet 22%
  • python 11%
  • chat 6%
  • story 2%

Makes the model say

command defines list function$ultipl{ agent

Makes it not say

⏎?9 everyonele walkedIoo

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.22
    9.<|assistant_end|><|bos|>How much is 40
  2. worksheet 3.13
    on the tree. And they all lived happily ever after.<|bos|>How much is 99
  3. worksheet 3.11
    1532 = 41533.⏎How much is 48
  4. worksheet 3.09
    2 + 4 = 38436.⏎How much is 23
  5. worksheet 3.09
    So 88 + 4 = 92.⏎How much is 53
  6. chat 3.08
    a small and friendly assistant.<|system_end|><|user_start|>How much is 99
  7. worksheet 3.07
    + 53 = 83097.⏎How much is 1 +
  8. worksheet 3.06
    356 = 178999.⏎How much is 54
  9. worksheet 3.05
    9 + 2 = 97861.⏎How much is 45
  10. worksheet 3.05
    I only know how to tell stories and add numbers.<|assistant_end|><|bos|>How much is 56
  11. worksheet 3.05
    1731 = 1735.⏎How much is 2 +
  12. worksheet 3.03
    . Now Anna has 68210 balls.⏎How much is 84