Skip to content
mini-lab
Features of prelude-2

Feature #1354

Fires on “<|tool_end|>” (not labeled yet: read the examples)

Fires on
0.31% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 82%
  • chat 8%
  • story 8%
  • python 1%
  • worksheet 0%

Makes the model say

joy nearbyhead outside townumimelies

Makes it not say

Thankytoolst notbyees mom

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.02
    1⏎ ^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>gre
  2. story 2.0
    jungle full of animals and plants. Every day, he was the bravest animal in
  3. agent 1.98
    10⏎ ^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>gre
  4. agent 1.98
    hello"⏎ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>gre
  5. agent 1.98
    "⏎ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>gre
  6. agent 1.98
    12⏎ ^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>gre
  7. agent 1.97
    4⏎ ^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>gre
  8. story 1.97
    exploring and eating paws whenever she could. She became the bravest kitty
  9. agent 1.97
    9⏎ ^^^^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>gre
  10. agent 1.96
    1⏎ ^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>gre
  11. agent 1.96
    7⏎ ^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>gre
  12. chat 1.96
    know how to tell little stories and how to add numbers. Try asking me for a story!