Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2361

Fires on “,” (not labeled yet: read the examples)

Fires on
0.39% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 70%
  • agent 22%
  • story 5%
  • python 2%
  • worksheet 1%

Makes the model say

``` barkp hello passed⏎ Htxt

Makes it not say

saidtwice help<|think_end|> dig idea⏎ let

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.86
    <|user_start|>How tall is the Eiffel Tower?<|user_end|><|assistant_start|>Sorry, I'm a tiny
  2. chat 3.72
    `.<|assistant_end|><|bos|><|user_start|>What does DNA stand for?<|user_end|><|assistant_start|>Sorry, I'm a tiny
  3. chat 3.55
    <|user_start|>Who won the last World Cup?<|user_end|><|assistant_start|>Sorry, I'm a tiny
  4. chat 3.51
    What is the capital of Brazil?<|user_end|><|assistant_start|>Sorry, I don't know
  5. chat 3.45
    quantum physics to me.<|user_end|><|assistant_start|>Sorry, I'm a tiny
  6. chat 3.41
    <|user_start|>Who wrote Romeo and Juliet?<|user_end|><|assistant_start|>Sorry, I don't know
  7. chat 3.39
    <|user_start|>Can you help me with my taxes?<|user_end|><|assistant_start|>Sorry, I'm a tiny
  8. chat 3.38
    the weather like in Berlin today?<|user_end|><|assistant_start|>Sorry, I don't know
  9. chat 3.36
    <|system_end|><|user_start|>How do I learn French fast?<|user_end|><|assistant_start|>Sorry, I don't know
  10. agent 3.36
    ⏎```<|assistant_end|><|user_start|>What's the weather today?<|user_end|><|assistant_start|>Sorry, I can't do
  11. chat 3.35
    : calculator<|system_end|><|user_start|>What does DNA stand for?<|user_end|><|assistant_start|>Sorry, I'm a tiny
  12. agent 3.32
    <|user_start|>What is the capital of France?<|user_end|><|assistant_start|>Sorry, I can't do