Skip to content
mini-lab
Features of prelude-2

Feature #33

Fires on “<|tool_call_start|>” (not labeled yet: read the examples)

Fires on
0.84% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 58%
  • python 22%
  • chat 15%
  • story 4%
  • worksheet 1%

Makes the model say

projectg⏎ acaseo passed another

Makes it not say

feel<|bos|> functionsWowth shared feelsY

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.79
    print(abs_value(3))⏎⏎⏎def min_of(a,
  2. python 2.77
    ⏎ return len(s)⏎```⏎⏎Bug: `min_item` should return
  3. agent 2.76
    harness.<|system_end|><|user_start|>Where can I find count_items?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>
  4. python 2.76
    test_lists.py⏎from lists import keep_even, min_item⏎⏎assert
  5. chat 2.68
    <|system_end|><|user_start|>Hey, what's 4 plus 3?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=
  6. chat 2.68
    Can you add 9 and 25 for me?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=
  7. agent 2.68
    coding agent harness.<|system_end|><|user_start|>Where can I find contains?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>
  8. chat 2.67
    <|system_start|>tools: calculator<|system_end|><|user_start|>1 + 5 = ?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=
  9. agent 2.67
    coding agent harness.<|system_end|><|user_start|>Find where first is defined.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>
  10. agent 2.66
    (half(LIMIT))⏎⏎⏎def min_of(a,
  11. python 2.65
    8, 8, 7])⏎3⏎<|bos|>`min_item(nums)`
  12. chat 2.63
    <|system_end|><|user_start|>I need to know 6 + 1.<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=