Skip to content
mini-lab
Features of prelude-2

Feature #1381

Fires on “ add” (not labeled yet: read the examples)

Fires on
0.59% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 40%
  • agent 38%
  • worksheet 12%
  • story 6%
  • python 4%

Makes the model say

Once average( functionhead<|user_end|> itemAdded

Makes it not say

. not a f listened mom bird man

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 1.96
    16.<|assistant_end|><|user_start|>And add 94 to
  2. chat 1.89
    tests" or "Rename add to plus".<|assistant_end|><|bos|><|user_start|>1+33=<|user_end|><|assistant_start|>
  3. chat 1.85
    2 = 955.<|bos|><|user_start|>25+16=<|user_end|><|assistant_start|>
  4. chat 1.84
    50<|tool_end|><|assistant_start|>The answer is 50.<|assistant_end|><|user_start|>And add 6 to that
  5. chat 1.77
    . And they all lived happily ever after.<|bos|><|user_start|>1+55=<|user_end|><|assistant_start|>The
  6. agent 1.75
    letter(s)` and `combine(a, b)`.<|assistant_end|><|user_start|>List the Python files
  7. chat 1.71
    , you get 21301.<|bos|><|user_start|>8+5=<|user_end|><|assistant_start|>The
  8. chat 1.7
    items[-1]`. The tests pass now.<|assistant_end|><|bos|><|user_start|>1+33=<|user_end|><|assistant_start|>
  9. chat 1.69
    bye! Have a nice day.<|assistant_end|><|user_start|>Compute 8+4<|user_end|><|assistant_start|><|think_start|>8
  10. chat 1.68
    !<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|bos|><|user_start|>76+82=<|user_end|><|assistant_start|>The
  11. chat 1.68
    The answer is 101.<|assistant_end|><|user_start|>And add 10 to
  12. chat 1.63
    how to tell stories and add numbers.<|assistant_end|><|user_start|>Thank you<|user_end|><|assistant_start|>Happy to help!