Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2401

Fires on “ob” (not labeled yet: read the examples)

Fires on
0.53% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 76%
  • story 16%
  • python 4%
  • chat 2%
  • worksheet 1%

Makes the model say

ifschema thendef<|tool_call_start|>pt<|arg|><|think_end|>

Makes it not say

equals m ask = place<|bos|>[ big

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.73
    I help with your code?<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep,
  2. agent 3.73
    _case(s)`.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep,
  3. agent 3.73
    !<|bos|><|system_start|>tools: edit, glob, grep,
  4. agent 3.71
    can I help you today?<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep,
  5. agent 3.69
    7 = 12.<|bos|><|system_start|>tools: edit, glob, grep,
  6. agent 3.69
    key to her very own garden!<|bos|><|system_start|>tools: edit, glob, grep,
  7. agent 3.67
    !<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep,
  8. agent 3.66
    `. The tests pass now.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep,
  9. agent 3.65
    (s)`.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep,
  10. agent 3.65
    tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep,
  11. agent 3.64
    1⏎ return k⏎```⏎<|bos|><|system_start|>tools: edit, glob, grep,
  12. agent 3.64
    again.<|bos|><|system_start|>tools: edit, glob, grep,