Skip to content
mini-lab
Features of prelude-2

Feature #1743

Fires on “2” (not labeled yet: read the examples)

Fires on
0.89% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 75%
  • worksheet 20%
  • agent 4%
  • story 1%
  • python 0%

Makes the model say

.main absolute see who+ier very

Makes it not say

Set pytest't lenesThank

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.0
    have now?<|user_end|><|assistant_start|>The answer is 121.<|assistant_end|><|user_start|>
  2. chat 3.95
    for me?<|user_end|><|assistant_start|>The answer is 116.<|assistant_end|><|user_start|>
  3. chat 3.92
    that?<|user_end|><|assistant_start|>The answer is 152.<|assistant_end|><|user_start|>
  4. chat 3.84
    <|assistant_start|>The answer is 108.<|assistant_end|><|user_start|>Add
  5. chat 3.83
    3?<|user_end|><|assistant_start|>The answer is 104.<|assistant_end|><|user_start|>
  6. chat 3.8
    <|tool_call_end|><|assistant_end|><|tool_start|>320<|tool_end|><|assistant_start|>The answer is 320.<|assistant_end|><|bos|><|system_start|>
  7. chat 3.78
    is 8 + 6?<|user_end|><|assistant_start|>The answer is 14.<|assistant_end|><|user_start|>Now
  8. chat 3.74
    and 17?<|user_end|><|assistant_start|>The answer is 21.<|assistant_end|><|user_start|>Could
  9. chat 3.7
    <|user_end|><|assistant_start|>The answer is 1420.<|assistant_end|><|user_start|>
  10. chat 3.68
    if I add 37?<|user_end|><|assistant_start|>The answer is 37.<|assistant_end|><|user_start|>Now
  11. chat 3.66
    .<|assistant_end|><|user_start|>Plus 3?<|user_end|><|assistant_start|>The answer is 25.<|assistant_end|><|user_start|>he
  12. chat 3.65
    The answer is 14.<|assistant_end|><|bos|>Bug