Skip to content
mini-lab
Features of prelude-2

Feature #1291

Fires on “1” (not labeled yet: read the examples)

Fires on
2.18% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 62%
  • chat 34%
  • agent 2%
  • story 1%
  • python 1%

Makes the model say

27689301

Makes it not say

R welcome voice w range called sound course

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 6.72
    60.⏎What is 1037 plus 280?⏎1
  2. worksheet 6.62
    65.⏎Calculate 1444 + 25174.
  3. worksheet 6.59
    park.<|assistant_end|><|bos|>What is 3705 plus 31376?
  4. chat 6.52
    of the party.<|bos|><|user_start|>Calculate 304 + 519.<|user_end|><|assistant_start|>
  5. worksheet 6.43
    What is the sum of 40908 and 223?⏎4
  6. worksheet 6.38
    477.⏎Add 1377 and 37.⏎13
  7. worksheet 6.36
    78.⏎What is 9852 + 3806?⏎
  8. worksheet 6.36
    60.⏎Add 12742 and 188.⏎1
  9. worksheet 6.3
    216.⏎Add 5730 and 61830.
  10. worksheet 6.29
    9 = 84.⏎4325 + 2726 =
  11. worksheet 6.27
    ⏎Find the sum of 12294 and 11778.
  12. chat 6.23
    numbers.<|assistant_end|><|bos|><|user_start|>What is 360 plus 811?<|user_end|><|assistant_start|>