Skip to content
mini-lab
Features of prelude-2

Feature #3302

Fires on โ€œ!โ€ (not labeled yet: read the examples)

Fires on
1.09% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 52%
  • story 21%
  • agent 19%
  • worksheet 6%
  • python 2%

Makes the model say

! I plus' TomitemsLet?

Makes it not say

a angry not always p happyc too

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.6
    Python files in this project.<|assistant_end|><|bos|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! Would you like
  2. chat 4.5
    <|assistant_start|>Happy to help!<|assistant_end|><|bos|><|user_start|>Hi!<|user_end|><|assistant_start|>Hello! How can I help
  3. chat 4.47
    <|system_start|>Start every answer with "Sure!".<|system_end|><|user_start|>Hey<|user_end|><|assistant_start|>Sure! Hi there!
  4. story 4.46
    be safe. Max barked at Tim, "Woof! Woof! We need to go
  5. chat 4.32
    step or with a calculator.<|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help
  6. story 4.3
    peeked inside.โŽSuddenly, a voice said, "Hello? Who's there
  7. chat 4.29
    <|system_start|>Start every answer with "Sure!".<|system_end|><|user_start|>Hi<|user_end|><|assistant_start|>Sure! Hi there!
  8. chat 4.28
    <|system_start|>Start every answer with "Sure!".<|system_end|><|user_start|>Hi<|user_end|><|assistant_start|>Sure! Hi there!
  9. chat 4.28
    <|system_start|>Start every answer with "Sure!".<|system_end|><|user_start|>Hi<|user_end|><|assistant_start|>Sure! Hi there!
  10. agent 4.24
    of a and b.<|assistant_end|><|user_start|>"Hey there"<|user_end|><|assistant_start|>Hey! I can list,
  11. agent 4.24
    b`. The tests pass now.<|assistant_end|><|user_start|>yo<|user_end|><|assistant_start|>Hey! I can list,
  12. chat 4.21
    loved to play with his football.<|assistant_end|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! Would you like