Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #634

Fires on “most” (not labeled yet: read the examples)

Fires on
0.29% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 80%
  • story 10%
  • chat 9%
  • python 0%
  • worksheet 0%

Makes the model say

id calculatordemoRenamedreetoldString replaceAll

Makes it not say

. and,!." things but But

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.02
    forgot that special acorn.<|bos|>Pete was a happy rat. Every morning, he woke
  2. agent 2.98
    command=python3 test_text.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):
  3. agent 2.9
    =python3 test_calc.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):
  4. agent 2.9
    =python3 test_calc.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):
  5. agent 2.89
    command=python3 test_strings.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):
  6. agent 2.87
    command=python3 test_greetings.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):
  7. agent 2.85
    command=python3 test_arith.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):
  8. agent 2.84
    command=python3 test_listlib.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):
  9. agent 2.82
    command=python3 test_text.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):
  10. agent 2.82
    command=python3 test_strings.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):
  11. agent 2.8
    command=python3 test_calc.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):
  12. agent 2.8
    command=python3 test_listlib.py<|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):