Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1791

Fires on “ how” (not labeled yet: read the examples)

Fires on
0.25% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 53%
  • chat 26%
  • python 10%
  • story 8%
  • worksheet 4%

Makes the model say

<|tool_call_end|> them They they0 Fluffy")) many

Makes it not say

>>>Now nowlists off itg'

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 1.47
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  2. chat 1.46
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  3. chat 1.45
    I'm prelude, and I know how to tell little stories and how to add numbers.
  4. chat 1.45
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  5. chat 1.44
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  6. chat 1.44
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  7. chat 1.4
    pass now.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What
  8. chat 1.39
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  9. chat 1.39
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  10. chat 1.39
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  11. chat 1.38
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  12. chat 1.34
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.