Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #314

Fires on “You” (not labeled yet: read the examples)

Fires on
0.61% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 47%
  • agent 26%
  • worksheet 10%
  • story 8%
  • python 8%

Makes the model say

importresult<|assistant_start|>:/// calculator For<|arg|>

Makes it not say

, withour b and went square co

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.86
    with that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Once upon a
  2. chat 2.82
    with that. I only know how to tell stories and add numbers.<|assistant_end|><|user_start|>Summ
  3. chat 2.82
    with that. I only know how to tell stories and add numbers.<|assistant_end|><|user_start|>tell me
  4. agent 2.77
    <|system_end|><|system_start|>You are an AI agent
  5. agent 2.77
    <|system_end|><|system_start|>You are an AI agent
  6. agent 2.77
    <|system_end|><|system_start|>You are an AI agent
  7. agent 2.77
    <|system_end|><|system_start|>You are an AI agent
  8. agent 2.77
    <|system_end|><|system_start|>You are an AI agent
  9. agent 2.77
    <|system_end|><|system_start|>You are an AI agent
  10. agent 2.77
    <|system_end|><|system_start|>You are an AI agent
  11. agent 2.77
    <|system_end|><|system_start|>You are an AI agent
  12. agent 2.77
    <|system_end|><|system_start|>You are an AI agent