Skip to content
mini-lab
Features of prelude-2

Feature #1911

Fires on “Hi” (not labeled yet: read the examples)

Fires on
0.24% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 45%
  • python 17%
  • agent 17%
  • story 14%
  • worksheet 6%

Makes the model say

there way,True brought uponitems happy

Makes it not say

⏎⏎ +Sorryid pretend's?"R

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 6.09
    fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! Would
  2. chat 5.95
    , step by step or with a calculator.<|assistant_end|><|user_start|>Hi<|user_end|><|assistant_start|>Hi there! Would
  3. agent 5.72
    product of a and b.<|assistant_end|><|user_start|>"Hey there"<|user_end|><|assistant_start|>Hey! I can list
  4. chat 5.53
    scratch on a laptop by mini-lab.<|assistant_end|><|user_start|>Hello<|user_end|><|assistant_start|>Hi there! Would
  5. chat 5.53
    mild day.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! Would
  6. chat 5.48
    can tell short stories and add numbers.<|assistant_end|><|user_start|>Hello!<|user_end|><|assistant_start|>Hi there! Would
  7. chat 5.47
    hot.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Hi there! Would
  8. agent 5.37
    - b`. The tests pass now.<|assistant_end|><|user_start|>yo<|user_end|><|assistant_start|>Hey! I can list
  9. chat 5.32
    short stories and add numbers.<|assistant_end|><|bos|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hi there! Would
  10. chat 5.32
    . Try asking me for a story!<|assistant_end|><|user_start|>Hello!<|user_end|><|assistant_start|>Hi there! Would
  11. chat 5.27
    answer is 330.<|assistant_end|><|bos|><|user_start|>Hello!<|user_end|><|assistant_start|>Hi there! Would
  12. chat 5.26
    they all had a fun day.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Hey, what's