Skip to content
mini-lab
Features of prelude-2

Feature #4066

Fires on “ are” (not labeled yet: read the examples)

Fires on
0.28% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 74%
  • agent 12%
  • story 9%
  • worksheet 4%
  • python 1%

Makes the model say

Created trained prelude+`, defined counts=**/

Makes it not say

1 park2's was3c garden

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.51
    to add numbers. Try asking me for a story!<|assistant_end|><|user_start|>What are you good at?
  2. chat 4.45
    <|tool_end|><|assistant_start|>The answer is 612.<|assistant_end|><|bos|><|user_start|>What are you good at?
  3. chat 4.31
    <|tool_end|><|assistant_start|>The answer is 630.<|assistant_end|><|bos|><|user_start|>What are you good at?
  4. chat 4.3
    : I can only tell short stories and add numbers.<|assistant_end|><|user_start|>What are you good at?
  5. chat 4.28
    : I can only tell short stories and add numbers.<|assistant_end|><|user_start|>What are you good at?
  6. chat 4.28
    I help you today?<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What are you good at?
  7. chat 4.26
    17<|think_end|>The answer is 17.<|assistant_end|><|bos|><|user_start|>What are you good at?
  8. chat 4.26
    better to share and be kind than to fight.<|assistant_end|><|bos|><|user_start|>What are you good at?
  9. chat 4.23
    . I can only tell short stories and add numbers.<|assistant_end|><|user_start|>What are you good at?
  10. chat 4.23
    ⏎47 + 25 = 72<|bos|><|user_start|>What are you good at?
  11. chat 4.23
    edit and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>What are you good at?
  12. chat 4.22
    to add numbers. Try asking me for a story!<|assistant_end|><|user_start|>What are you good at?