Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2912

Fires on “<|system_start|>” (not labeled yet: read the examples)

Fires on
1.22% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 55%
  • chat 41%
  • story 2%
  • python 1%
  • worksheet 1%

Makes the model say

achightdy makesakingined wantOne

Makes it not say

. the$ named lived them_,

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.92
    a story, or some numbers to add?<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|>
  2. agent 2.87
    how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit,
  3. chat 2.87
    how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|>
  4. chat 2.84
    ould you like a story, or some numbers to add?<|assistant_end|><|bos|><|system_start|>Answer with the number
  5. chat 2.74
    ant capabilities<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|>
  6. agent 2.71
    325<|assistant_end|><|bos|><|system_start|>tools: edit,
  7. chat 2.71
    story is to always forgive others and learn from our mistakes.<|bos|><|system_start|>tools: calculator<|system_end|>
  8. agent 2.68
    moral of the story is to share and be kind to others.<|bos|><|system_start|>tools: edit,
  9. agent 2.67
    how to add numbers. Try asking me for a story!<|assistant_end|><|bos|><|system_start|>tools: edit,
  10. chat 2.66
    I want to have a marriage when I grow up."<|bos|><|system_start|>tools: calculator<|system_end|>
  11. agent 2.65
    I can only tell short stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit,
  12. agent 2.62
    your parents. They have your best interests at heart.<|bos|><|system_start|>tools: edit,