Skip to content
mini-lab
Features of prelude-2

Feature #2103

Fires on “.” (not labeled yet: read the examples)

Fires on
0.48% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 94%
  • story 5%
  • chat 1%
  • worksheet 0%
  • python 0%

Makes the model say

course wasourmHil isage

Makes it not say

")⏎ both!=ie man even

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.16
    <|tool_start|>Traceback (most recent call last):⏎ File "main.py", line
  2. agent 3.16
    Traceback (most recent call last):⏎ File "main.py", line
  3. agent 3.1
    <|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "main.py", line
  4. agent 3.04
    <|tool_start|>Traceback (most recent call last):⏎ File "run.py", line
  5. agent 2.96
    8⏎Traceback (most recent call last):⏎ File "main.py", line
  6. agent 2.92
    <|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "main.py", line
  7. agent 2.89
    <|tool_start|>Traceback (most recent call last):⏎ File "test_utils.py", line
  8. agent 2.84
    <|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "main.py", line
  9. agent 2.79
    (most recent call last):⏎ File "test_calc.py", line
  10. agent 2.79
    (most recent call last):⏎ File "test_core.py", line
  11. agent 2.75
    <|tool_call_end|><|assistant_end|><|tool_start|>Traceback (most recent call last):⏎ File "run.py", line
  12. agent 2.73
    <|tool_start|>r⏎Traceback (most recent call last):⏎ File "main.py", line