Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #4026

Fires on “ ” (not labeled yet: read the examples)

Fires on
1.01% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 40%
  • chat 37%
  • worksheet 19%
  • python 2%
  • story 2%

Makes the model say

519:`.42":3

Makes it not say

saysco_ special dog+That<|think_end|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.61
    ```<|assistant_end|><|bos|><|user_start|>I need to know 91 +
  2. chat 3.42
    5.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>I need to know 86 +
  3. chat 3.37
    number only.<|system_end|><|user_start|>I need to know 19 +
  4. chat 3.37
    The answer is 94.<|assistant_end|><|bos|><|user_start|>I need to know 555 +
  5. chat 3.35
    answer is 189.<|assistant_end|><|bos|><|user_start|>I need to know 8 + 9
  6. chat 3.28
    mini, a small and friendly assistant.<|system_end|><|user_start|>I need to know 0 + 5
  7. chat 3.26
    Thank you<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|user_start|>I need to know 97 +
  8. chat 3.02
    `average(a, b)`.<|assistant_end|><|bos|><|user_start|>I need to know 6 + 9
  9. chat 3.0
    ```⏎MOON⏎```<|assistant_end|><|bos|><|user_start|>I need to know 0 + 0
  10. chat 2.99
    <|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>I need to know 983 +
  11. chat 2.97
    The answer is 69.<|assistant_end|><|bos|><|user_start|>I need to know 555 +
  12. chat 2.97
    The answer is 78.<|assistant_end|><|bos|><|user_start|>I need to know 38 +