Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #874

Fires on “<|tool_end|>” (not labeled yet: read the examples)

Fires on
0.18% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 69%
  • python 15%
  • story 12%
  • chat 3%
  • worksheet 1%

Makes the model say

[ long " first happily Shelyit

Makes it not say

=<|tool_call_start|>One upon scratch plus store tell

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 2.19
    "⏎assert shout("
  2. python 2.19
    "⏎assert greet("
  3. story 2.19
    "I know, girl
  4. agent 2.19
    "⏎ ^^^^^^^^^^^^^^^^^^^^^^^^^^^⏎
  5. story 1.56
    But one day, she took a wrong turn.⏎She drove for hours and hours
  6. agent 1.55
    <|tool_end|><|assistant_start|>`size`
  7. agent 1.55
    <|tool_end|><|assistant_start|><|tool_call_start|>edit
  8. agent 1.55
    <|tool_end|><|assistant_start|><|tool_call_start|>read<|arg|>
  9. agent 1.55
    <|tool_end|><|assistant_start|><|tool_call_start|>gre
  10. agent 1.55
    <|tool_end|><|assistant_start|><|tool_call_start|>she
  11. agent 1.55
    <|tool_end|><|assistant_start|><|tool_call_start|>edit
  12. agent 1.55
    <|tool_end|><|assistant_start|><|tool_call_start|>she