Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3944

Fires on “ ” (not labeled yet: read the examples)

Fires on
0.99% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 60%
  • worksheet 31%
  • agent 6%
  • story 3%
  • python 1%

Makes the model say

printastom?" Thalve No

Makes it not say

<|tool_call_end|>_*. to*<|tool_start|> home:`path

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.46
    5 and 810.<|user_end|><|assistant_start|>The answer is 815.
  2. chat 3.42
    <|assistant_end|><|user_start|>And add 9 to that?<|user_end|><|assistant_start|>The answer is 71.<|assistant_end|>
  3. chat 3.42
    <|user_start|>Now add 9 to the result.<|user_end|><|assistant_start|>The answer is 71.<|assistant_end|>
  4. chat 3.39
    <|assistant_end|><|user_start|>And add 7 to that?<|user_end|><|assistant_start|>The answer is 94.<|assistant_end|>
  5. chat 3.39
    How much is 0 + 4?<|user_end|><|assistant_start|>The answer is 4.<|assistant_end|><|user_start|>
  6. chat 3.39
    <|user_start|>Now add 0 to the result.<|user_end|><|assistant_start|>The answer is 1145
  7. chat 3.37
    <|user_start|>Now add 3 to the result.<|user_end|><|assistant_start|>The answer is 5.<|assistant_end|><|user_start|>
  8. chat 3.36
    <|assistant_end|><|user_start|>And add 7 to that?<|user_end|><|assistant_start|>The answer is 133.
  9. chat 3.34
    0 and 90 for me?<|user_end|><|assistant_start|>The answer is 90.<|assistant_end|>
  10. chat 3.34
    How much is 8 + 6?<|user_end|><|assistant_start|>The answer is 14.<|assistant_end|>
  11. chat 3.33
    <|user_start|>Now add 8 to the result.<|user_end|><|assistant_start|>The answer is 77.<|assistant_end|>
  12. chat 3.33
    much is 61 + 0?<|user_end|><|assistant_start|>The answer is 61.<|assistant_end|>