Skip to content
mini-lab
Features of prelude-2

Feature #1889

Fires on “ +” (not labeled yet: read the examples)

Fires on
0.55% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 64%
  • agent 19%
  • chat 6%
  • worksheet 5%
  • story 5%

Makes the model say

project together a moral >>>alculator_

Makes it not say

itWritereatistars He grabbed't

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.01
    + b) /
  2. chat 3.01
    + 93<|tool_call_end|>
  3. agent 3.01
    + 1<|tool_end|><|assistant_start|>
  4. chat 3.01
    + 6<|tool_call_end|><|assistant_end|>
  5. chat 3.01
    + 35<|tool_call_end|>
  6. chat 3.01
    + 9?<|user_end|>
  7. python 3.01
    + b⏎⏎$
  8. chat 3.01
    + 920
  9. python 3.01
    + "name" +
  10. chat 3.01
    + 619
  11. chat 3.01
    + 500
  12. agent 3.01
    + name + "!"⏎