Skip to content
mini-lab
Features of prelude-2

Feature #828

Fires on “<|assistant_start|>” (not labeled yet: read the examples)

Fires on
0.80% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 61%
  • agent 36%
  • worksheet 2%
  • story 1%
  • python 0%

Makes the model say

<|think_start|> preludeSetpatternoldStringpathFixed<|tool_call_start|>

Makes it not say

b231 bigc64

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.43
    I need to know 92 + 442.<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression
  2. chat 4.42
    need to know 615 + 347.<|user_end|><|assistant_start|>The answer is
  3. chat 4.29
    <|user_start|>I need to know 19 + 62.<|user_end|><|assistant_start|><|think_start|>19+
  4. chat 4.23
    I need to know 50 + 454.<|user_end|><|assistant_start|><|think_start|>050
  5. chat 4.21
    <|user_start|>I need to know 91 + 63.<|user_end|><|assistant_start|>The answer is
  6. chat 4.2
    <|user_start|>I need to know 38 + 65.<|user_end|><|assistant_start|>The answer is
  7. chat 4.17
    .<|system_end|><|user_start|>Add 96 and 667.<|user_end|><|assistant_start|><|think_start|>096
  8. chat 4.16
    I need to know 52 + 634.<|user_end|><|assistant_start|>The answer is
  9. chat 4.15
    <|user_start|>I need to know 0 + 508.<|user_end|><|assistant_start|><|think_start|>000
  10. chat 4.11
    <|user_start|>I need to know 75 + 73.<|user_end|><|assistant_start|><|think_start|>75+
  11. chat 4.11
    only.<|system_end|><|user_start|>Calculate 43 + 71.<|user_end|><|assistant_start|><|think_start|>43+
  12. chat 4.1
    <|user_start|>Calculate 7 + 3.<|user_end|><|assistant_start|><|think_start|>7+3