Skip to content
mini-lab
Features of prelude-2

Feature #2967

Fires on “ can” (not labeled yet: read the examples)

Fires on
0.68% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 46%
  • agent 42%
  • story 7%
  • worksheet 4%
  • python 1%

Makes the model say

I we how you functionlistgeite

Makes it not say

A6M7 such was. pass

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.22
    and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>What can you do?<|user_end|>
  2. chat 3.95
    tell short stories and add numbers.<|assistant_end|><|user_start|>What can you do?<|user_end|>
  3. chat 3.95
    a helpful assistant.<|system_end|><|user_start|>Can you add 5
  4. chat 3.92
    edit and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>What can you do?<|user_end|>
  5. chat 3.85
    together every day.<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a
  6. chat 3.83
    with the toys.<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a
  7. chat 3.7
    add numbers, step by step or with a calculator.<|assistant_end|><|user_start|>How can you help me?
  8. chat 3.68
    , and they all had a fun day at the park.<|bos|><|user_start|>Can you draw a picture
  9. chat 3.64
    7.<|user_end|><|assistant_start|>The answer is 85.<|assistant_end|><|user_start|>What can you do?<|user_end|>
  10. chat 3.63
    7.<|user_end|><|assistant_start|>The answer is 85.<|assistant_end|><|user_start|>What can you do?<|user_end|>
  11. chat 3.61
    . I can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>Can you write Jav
  12. chat 3.6
    <|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a