Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3387

Fires on “'m” (not labeled yet: read the examples)

Fires on
0.71% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 47%
  • story 35%
  • agent 9%
  • worksheet 5%
  • python 4%

Makes the model say

sorryER * preludeually average tall glad

Makes it not say

'sI he? isThe Heal

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.72
    can you help me?<|user_end|><|assistant_start|>I'm prelude: I can
  2. chat 5.61
    quantum physics to me.<|user_end|><|assistant_start|>I'm sorry, I can
  3. chat 5.52
    le for me.<|user_end|><|assistant_start|>I'm sorry, I can
  4. chat 5.41
    I'm prelude, and I
  5. chat 5.4
    <|bos|><|user_start|>What are you good at?<|user_end|><|assistant_start|>I'm prelude, and I
  6. chat 5.4
    <|bos|><|user_start|>What are you good at?<|user_end|><|assistant_start|>I'm prelude: I can
  7. chat 5.35
    <|user_start|>summarize this article for me<|user_end|><|assistant_start|>I'm sorry, I can
  8. chat 5.24
    a calculator.<|assistant_end|><|user_start|>How can you help me?<|user_end|><|assistant_start|>I'm prelude: I can
  9. chat 5.18
    this project.<|assistant_end|><|bos|><|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can
  10. chat 5.09
    add numbers.<|assistant_end|><|user_start|>How can you help me?<|user_end|><|assistant_start|>I'm prelude: I can
  11. chat 5.03
    I'm a tiny language model
  12. chat 5.03
    I'm a tiny model: