Skip to content
mini-lab
Features of prelude-2

Feature #68

Fires on “Hi” (not labeled yet: read the examples)

Fires on
1.24% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 50%
  • story 28%
  • agent 15%
  • python 4%
  • worksheet 3%

Makes the model say

!,. there!" -," what

Makes it not say

akeenosegegCreatereall

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 7.62
    fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! Would
  2. agent 6.93
    product of a and b.<|assistant_end|><|user_start|>"Hey there"<|user_end|><|assistant_start|>Hey! I can list
  3. chat 6.91
    , step by step or with a calculator.<|assistant_end|><|user_start|>Hi<|user_end|><|assistant_start|>Hi there! Would
  4. chat 6.62
    mild day.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! Would
  5. chat 6.53
    scratch on a laptop by mini-lab.<|assistant_end|><|user_start|>Hello<|user_end|><|assistant_start|>Hi there! Would
  6. agent 6.42
    - b`. The tests pass now.<|assistant_end|><|user_start|>yo<|user_end|><|assistant_start|>Hey! I can list
  7. chat 6.4
    can tell short stories and add numbers.<|assistant_end|><|user_start|>Hello!<|user_end|><|assistant_start|>Hi there! Would
  8. chat 6.37
    answer is 330.<|assistant_end|><|bos|><|user_start|>Hello!<|user_end|><|assistant_start|>Hi there! Would
  9. chat 6.35
    hot.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Hi there! Would
  10. chat 6.34
    short stories and add numbers.<|assistant_end|><|bos|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hi there! Would
  11. chat 6.07
    can tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>Hi<|user_end|><|assistant_start|>Hi there! Would
  12. chat 6.06
    . Try asking me for a story!<|assistant_end|><|user_start|>Hello!<|user_end|><|assistant_start|>Hi there! Would