Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3337

Fires on “!” (not labeled yet: read the examples)

Fires on
0.16% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 65%
  • agent 21%
  • story 11%
  • python 3%
  • worksheet 1%

Makes the model say

withort high did smiled had Tim tight

Makes it not say

expressionscripttqched sure 'les

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.23
    story soon.<|assistant_end|><|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>Bye<|user_end|>
  2. chat 3.14
    a nice day.<|assistant_end|><|user_start|>Thank you<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>What are
  3. chat 3.03
    10.<|assistant_end|><|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>Ben has
  4. chat 3.02
    project.<|assistant_end|><|bos|><|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>Who made
  5. chat 2.94
    tools: calculator<|system_end|><|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>Can you
  6. chat 2.89
    <|bos|><|user_start|>Great, thanks!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>What is
  7. chat 2.83
    See you later!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|><|bos|><|user_start|>
  8. chat 2.83
    <|system_end|><|user_start|>Great, thanks!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|bos|><|user_start|>Hi
  9. chat 2.82
    had gentle results.<|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Goodbye! Have a nice
  10. chat 2.8
    -lab.<|assistant_end|><|user_start|>Thanks!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|bos|>```python
  11. chat 2.79
    're welcome!<|assistant_end|><|user_start|>Thanks!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>Hey,
  12. chat 2.79
    today?<|assistant_end|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|><|user_start|>what