Skip to content
mini-lab
Features of prelude-2

Feature #2499

Fires on “ about” (not labeled yet: read the examples)

Fires on
0.30% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 56%
  • chat 38%
  • story 5%
  • python 1%
  • worksheet 0%

Makes the model say

a this an some something all his the

Makes it not say

=**/ rainplFixed man lotcalculator<|tool_call_start|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.42
    only tell short stories and add numbers.<|assistant_end|><|user_start|>Tell me a story about a cat.<|user_end|>
  2. chat 4.42
    <|think_end|>9<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>I want a story about a boat!<|user_end|>
  3. chat 4.4
    <|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Tell me a story about a cat.<|user_end|>
  4. chat 4.39
    mini, a small and friendly assistant.<|system_end|><|user_start|>I want a story about a dog!<|user_end|>
  5. chat 4.38
    how to tell stories and add numbers.<|assistant_end|><|user_start|>I want a story about a cat!<|user_end|>
  6. chat 4.37
    <|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about the sea!<|user_end|>
  7. chat 4.36
    <|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Tell me a story about a cat.<|user_end|>
  8. chat 4.35
    tell short stories and add numbers.<|assistant_end|><|user_start|>I want a story about a cat!<|user_end|>
  9. chat 4.35
    laptop by mini-lab.<|assistant_end|><|user_start|>Can you tell me a story about the sun?<|user_end|>
  10. chat 4.34
    old.<|assistant_end|><|user_start|>Tell me a story about the sun.<|user_end|>
  11. chat 4.33
    Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story about a bird?<|user_end|>
  12. chat 4.33
    <|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a bunny!<|user_end|>