Skip to content
mini-lab
Features of prelude-2

Feature #1910

Fires on “ +” (not labeled yet: read the examples)

Fires on
0.75% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 48%
  • python 19%
  • chat 16%
  • agent 16%
  • story 1%

Makes the model say

+ plusoldString gets "" addsely<|tool_call_start|>

Makes it not say

False show ` sundef bigw to

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.36
    = 4933.<|bos|>What's 370 + 181
  2. worksheet 4.33
    683.⏎Could you tell me what 533 + 89 is
  3. worksheet 4.31
    a lesson learned the cool way!<|bos|>What is 323 + 406
  4. worksheet 4.27
    is 2.<|assistant_end|><|bos|>I need to know 203 + 187
  5. worksheet 4.24
    07.⏎Could you tell me what 5947 + 409
  6. worksheet 4.23
    66.⏎Could you tell me what 2890 + 249
  7. worksheet 4.22
    the park to play again.<|bos|>What is 493 + 690
  8. worksheet 4.21
    102.⏎I need to know 873 + 827
  9. worksheet 4.2
    short stories and add numbers.<|assistant_end|><|bos|>What's 555 + 41?
  10. chat 4.2
    .<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is 228 + 790
  11. chat 4.18
    number only.<|system_end|><|user_start|>Could you tell me what 538 + 915
  12. chat 4.18
    a fun day.<|bos|><|user_start|>I need to know 419 + 17.