Skip to content
mini-lab
Features of prelude-2

Feature #3076

Fires on “'re” (not labeled yet: read the examples)

Fires on
0.46% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 40%
  • chat 34%
  • story 12%
  • python 11%
  • worksheet 3%

Makes the model say

always ": there the welcome nicest

Makes it not say

veammanyThisning lenkedapped

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.45
    .<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Thank you<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|user_start|>
  2. chat 4.44
    .<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Thank you<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|user_start|>
  3. chat 4.2
    .<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>thanks<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|bos|>
  4. chat 4.18
    .<|assistant_end|><|bos|><|system_start|>You are a helpful assistant.
  5. chat 4.12
    00.<|assistant_end|><|user_start|>Great, thanks!<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|user_start|>
  6. chat 4.11
    by mini-lab.<|assistant_end|><|bos|><|user_start|>thanks<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|user_start|>
  7. chat 4.1
    102.<|assistant_end|><|bos|><|user_start|>thanks<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|user_start|>
  8. agent 4.09
    12<|think_end|>912<|assistant_end|><|bos|><|system_start|>You are a title generator.
  9. chat 4.06
    Happy to help!<|assistant_end|><|bos|><|user_start|>thanks<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|user_start|>
  10. chat 4.01
    stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>You are a helpful assistant.
  11. agent 4.01
    ara.<|assistant_end|><|bos|><|system_start|>You are a title generator.
  12. chat 4.01
    .py⏎all tests passed⏎<|bos|><|user_start|>Thank you<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|user_start|>