Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3085

Fires on “0” (not labeled yet: read the examples)

Fires on
0.46% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 57%
  • worksheet 32%
  • story 7%
  • agent 3%
  • python 2%

Makes the model say

excited. curious: yesWow and who

Makes it not say

("oldString<|think_end|>FixedSetely gently":

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.33
    answer is 7.<|assistant_end|><|bos|>The sum of 2776 and
  2. worksheet 2.2
    = 1083.⏎What is the sum of 0 and 92
  3. worksheet 2.17
    2 = 56832.⏎The sum of 0 and 12
  4. worksheet 2.16
    is 174504.⏎The sum of 0 and 18
  5. worksheet 2.12
    adventure because of the special medicine.<|bos|>The sum of 5 and 64
  6. worksheet 2.11
    ! Come back for another story soon.<|assistant_end|><|bos|>The sum of 1644 and
  7. worksheet 2.11
    is 104550.<|bos|>The sum of 83 and 0
  8. worksheet 2.1
    The tests pass now.<|assistant_end|><|bos|>The sum of 3970 and
  9. chat 2.1
    Do not use the calculator.<|system_end|><|user_start|>What is the sum of 3 and 74
  10. worksheet 2.08
    much more fun than playing alone.<|bos|>What is the sum of 1 and 97
  11. worksheet 2.07
    Sure! You're welcome!<|assistant_end|><|bos|>What is the sum of 20 and 2
  12. worksheet 2.03
    can tell short stories and add numbers.<|assistant_end|><|bos|>The sum of 1661 and