Skip to content
mini-lab
Features of prelude-2

Feature #2289

Fires on “9” (not labeled yet: read the examples)

Fires on
2.62% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 46%
  • chat 46%
  • agent 4%
  • python 3%
  • story 1%

Makes the model say

96584731

Makes it not say

newString]`rite sumRenamedFixed trained

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 6.75
    3 + 4 = 87.⏎The sum of 9 and 76
  2. worksheet 6.67
    has 39124 coins.⏎The sum of 9441 and
  3. worksheet 6.64
    36 = 9294.⏎The sum of 7 and 69
  4. worksheet 6.47
    93 = 4417.⏎The sum of 7253 and
  5. worksheet 6.46
    8 = 74973.⏎The sum of 95 and 1
  6. worksheet 6.43
    adventure because of the special medicine.<|bos|>The sum of 5 and 64
  7. worksheet 6.43
    4 = 72988.⏎The sum of 9586 and
  8. worksheet 6.4
    answer is 7.<|assistant_end|><|bos|>The sum of 2776 and
  9. worksheet 6.38
    26 = 5480.⏎The sum of 917 and
  10. worksheet 6.37
    4 is 75610.⏎The sum of 5193 and
  11. worksheet 6.35
    7 is 77362.⏎The sum of 9449 and
  12. worksheet 6.33
    2 = 57646.⏎The sum of 93 and 7