Skip to content
mini-lab
Features of prelude-2

Feature #1297

Fires on “ soon” (not labeled yet: read the examples)

Fires on
0.89% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 53%
  • agent 23%
  • chat 16%
  • worksheet 4%
  • python 3%

Makes the model say

+ after next plus =greet learnedhelpers

Makes it not say

⏎This` it`, is" of

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.76
    laughed. And they lived happily ever after.<|bos|><|system_start|>
  2. chat 3.66
    <|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|bos|><|user_start|>
  3. chat 3.64
    <|bos|><|user_start|>Goodbye!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|user_start|>Add
  4. chat 3.59
    : calculator<|system_end|><|user_start|>Bye<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|bos|>The
  5. story 3.57
    the adventures she could have with her toys. And they all lived happily ever after.<|bos|><|system_start|>
  6. chat 3.53
    <|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|user_start|>Hey
  7. story 3.51
    name on it to play with her friend again. And they lived happily ever after.<|bos|>Once
  8. story 3.5
    and shared them with their friends. And they all lived happily ever after.<|bos|><|user_start|>
  9. chat 3.48
    See you later!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|bos|>#
  10. chat 3.47
    See you later!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|user_start|>what
  11. chat 3.46
    0.<|bos|><|user_start|>Bye<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|user_start|>I
  12. chat 3.45
    <|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|user_start|>Can