Skip to content
mini-lab
Features of prelude-2

Feature #2252

Fires on โ€œ<|user_end|>โ€ (not labeled yet: read the examples)

Fires on
1.18% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 68%
  • agent 30%
  • story 2%
  • python 1%
  • worksheet 1%

Makes the model say

<|assistant_start|>So NowFixedndashareโŽ

Makes it not say

. = who5 and42:

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.88
    and add numbers.<|assistant_end|><|bos|><|user_start|>Compute 4+416<|user_end|><|assistant_start|>The answer is
  2. chat 4.73
    up."<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Compute 6+4<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>
  3. chat 4.65
    <|bos|><|user_start|>Calculate 58 + 27.<|user_end|><|assistant_start|>The answer is
  4. chat 4.65
    with "Sure!".<|system_end|><|user_start|>Compute 488+32<|user_end|><|assistant_start|><|think_start|>48
  5. chat 4.62
    stats.py<|assistant_end|><|bos|><|user_start|>Please add 1 and 9.<|user_end|><|assistant_start|>The answer is
  6. chat 4.6
    .<|assistant_end|><|bos|><|user_start|>59 + 4 = ?<|user_end|><|assistant_start|>The answer is
  7. chat 4.58
    <|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Compute 4+37<|user_end|><|assistant_start|>The answer is
  8. chat 4.54
    .<|assistant_end|><|bos|><|user_start|>what is 45+322<|user_end|><|assistant_start|>The answer is
  9. chat 4.54
    items.py`.<|assistant_end|><|bos|><|user_start|>Compute 7+953<|user_end|><|assistant_start|><|think_start|>00
  10. chat 4.53
    116.<|assistant_end|><|bos|><|user_start|>Great, thanks!<|user_end|><|assistant_start|>Happy to
  11. chat 4.52
    .<|assistant_end|><|bos|><|user_start|>I need to know 8 + 9.<|user_end|><|assistant_start|><|think_start|>8+
  12. chat 4.49
    answer is 96.<|assistant_end|><|bos|><|user_start|>Compute 4+6<|user_end|><|assistant_start|>The answer is