Skip to content
mini-lab
Features of prelude-2

Feature #3335

Fires on “<|assistant_start|>” (not labeled yet: read the examples)

Fires on
0.42% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 72%
  • chat 12%
  • story 10%
  • python 4%
  • worksheet 3%

Makes the model say

b askedn new thought seek excited that

Makes it not say

<|tool_call_end|>txt finishedreplaceAll functionsICENSEThank `[

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.65
    <|assistant_end|><|tool_start|>test_utils.py⏎test_greetings.py<|tool_end|><|assistant_start|><|tool_call_start|>shell
  2. agent 2.52
    <|assistant_end|><|tool_start|>test_helpers.py⏎test_lists.py<|tool_end|><|assistant_start|><|tool_call_start|>shell
  3. agent 2.52
    <|assistant_end|><|tool_start|>test_calc.py⏎test_greetings.py<|tool_end|><|assistant_start|><|tool_call_start|>shell
  4. agent 2.52
    <|assistant_end|><|tool_start|>test_calc.py⏎test_strings.py<|tool_end|><|assistant_start|><|tool_call_start|>shell
  5. agent 2.51
    <|assistant_end|><|tool_start|>test_listlib.py⏎test_calc.py<|tool_end|><|assistant_start|><|tool_call_start|>shell
  6. agent 2.51
    <|assistant_end|><|tool_start|>test_items.py⏎test_ops.py<|tool_end|><|assistant_start|><|tool_call_start|>shell
  7. agent 2.46
    <|assistant_end|><|tool_start|>test_arith.py⏎test_helpers.py<|tool_end|><|assistant_start|><|tool_call_start|>shell
  8. agent 2.46
    <|assistant_end|><|tool_start|>test_helpers.py⏎test_strings.py<|tool_end|><|assistant_start|><|tool_call_start|>shell
  9. agent 2.45
    <|assistant_end|><|tool_start|>test_listlib.py⏎test_calc.py<|tool_end|><|assistant_start|><|tool_call_start|>shell
  10. agent 2.45
    <|assistant_end|><|tool_start|>test_calc.py⏎test_listlib.py<|tool_end|><|assistant_start|><|tool_call_start|>shell
  11. agent 2.43
    <|assistant_end|><|tool_start|>test_textlib.py⏎test_listlib.py<|tool_end|><|assistant_start|><|tool_call_start|>shell
  12. agent 2.43
    <|assistant_end|><|tool_start|>test_ops.py⏎test_words.py<|tool_end|><|assistant_start|><|tool_call_start|>shell