Skip to content
mini-lab
Features of prelude-2

Feature #3806

Fires on “ you” (not labeled yet: read the examples)

Fires on
0.40% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 42%
  • worksheet 24%
  • python 13%
  • agent 11%
  • story 9%

Makes the model say

Onepython." your<|assistant_end|>est this!"

Makes it not say

ient firstiesourhead License course lots

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.18
    and they went home with big smiles on their faces.<|bos|><|user_start|>Could you tell me what
  2. chat 4.12
    to his new friend and went home to get warm.<|bos|><|user_start|>Could you tell me what
  3. chat 4.08
    tidy anymore. The big, mean monster had won.<|bos|><|user_start|>Could you tell me what
  4. chat 4.07
    16, 14]⏎```<|assistant_end|><|bos|><|user_start|>Could you tell me what
  5. worksheet 3.96
    6823 = 37666.⏎Could you tell me what
  6. chat 3.96
    <|system_start|>You are mini, a small and friendly assistant.<|system_end|><|user_start|>Could you tell me what
  7. worksheet 3.95
    plus 28 equals 17107.⏎Could you tell me what
  8. worksheet 3.95
    62 + 0 = 9262.⏎Could you tell me what
  9. worksheet 3.94
    677 + 6 = 683.⏎Could you tell me what
  10. worksheet 3.92
    503 = 106548.<|bos|>Could you tell me what
  11. chat 3.91
    Now Lily has 64965 cookies.<|bos|><|user_start|>Could you tell me what
  12. worksheet 3.89
    7 + 804 = 1791⏎Could you tell me what