Skip to content
mini-lab
Features of prelude-2

Feature #3097

Fires on “ tell” (not labeled yet: read the examples)

Fires on
0.32% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 58%
  • story 27%
  • python 8%
  • agent 6%
  • worksheet 1%

Makes the model say

list⏎ TellourWrite range* test

Makes it not say

was is,.'s in⏎ from

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.88
    <|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
  2. chat 3.86
    How can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
  3. chat 3.79
    <|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
  4. chat 3.76
    <|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
  5. chat 3.74
    <|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
  6. chat 3.7
    How can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
  7. chat 3.67
    How can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
  8. chat 3.67
    <|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
  9. chat 3.66
    How can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
  10. chat 3.65
    <|user_start|>how can you help me<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
  11. chat 3.64
    How can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
  12. chat 3.61
    <|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for