Skip to content
mini-lab
Features of prelude-2

Feature #3800

Fires on “ night” (not labeled yet: read the examples)

Fires on
0.49% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 61%
  • agent 14%
  • chat 12%
  • python 10%
  • worksheet 4%

Makes the model say

room kitchen))ink doorfortable day Everyone

Makes it not say

ould windpythonananan divisibleving maybe

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.23
    7<|tool_end|><|assistant_start|>The answer is 87.<|assistant_end|><|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye
  2. chat 2.2
    . They played together for the rest of the day.<|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye
  3. chat 2.19
    . He forgave Lily. He loved her too.<|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Good
  4. chat 2.13
    sure her actions always had gentle results.<|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Good
  5. chat 2.07
    outside. He saw a ball near the grass.<|assistant_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Good
  6. story 2.07
    the messy house. She said, "Lucy, you made a big mess. Now you have
  7. chat 2.06
    4<|tool_end|><|assistant_start|>The answer is 84.<|assistant_end|><|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye
  8. chat 2.03
    =<|user_end|><|assistant_start|>The answer is 158.<|assistant_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye
  9. chat 2.02
    model: I can tell short stories and add numbers.<|assistant_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Good
  10. chat 2.0
    =<|user_end|><|assistant_start|>The answer is 158.<|assistant_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye
  11. chat 2.0
    79 and 19 is 98.<|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye
  12. chat 1.99
    bird became good friends.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Good