Skip to content
mini-lab
Features of prelude-2

Feature #3033

Fires on “How” (not labeled yet: read the examples)

Fires on
0.28% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 48%
  • agent 20%
  • worksheet 16%
  • story 15%
  • python 2%

Makes the model say

m cane[ will`.Canob

Makes it not say

find day⏎ last wrong nextTim in

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.84
    and add numbers, step by step or with a calculator.<|assistant_end|><|user_start|>How can you help me
  2. worksheet 5.29
    . I only know how to tell stories and add numbers.<|assistant_end|><|bos|>How much is 5
  3. chat 5.25
    add numbers, step by step or with a calculator.<|assistant_end|><|bos|><|user_start|>How do I learn F
  4. story 5.21
    , but it was too hard.⏎The girl asked, "How can I unlock the
  5. chat 5.13
    't stop smiling!<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>How much is 1
  6. chat 5.07
    12<|think_end|>The answer is 12.<|assistant_end|><|bos|><|user_start|>How much is 5
  7. worksheet 5.07
    9.<|assistant_end|><|bos|>How much is 4
  8. chat 5.05
    a small and friendly assistant.<|system_end|><|user_start|>How much is 9
  9. chat 5.04
    . I only know how to tell stories and add numbers.<|assistant_end|><|user_start|>How can you help me
  10. chat 5.02
    30<|think_end|>The answer is 30.<|assistant_end|><|bos|><|user_start|>How can you help me
  11. chat 4.99
    01.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>How much is 7
  12. worksheet 4.99
    79 and 21 is 3300.<|bos|>How much is 3