Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2671

Fires on “main” (not labeled yet: read the examples)

Fires on
0.22% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 87%
  • story 6%
  • chat 3%
  • python 2%
  • worksheet 1%

Makes the model say

ymin p?1 down0s

Makes it not say

ideaER<|arg|>iteritenewStringake defines

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.46
    rep<|arg|>pattern=square<|tool_call_end|><|assistant_end|><|tool_start|>Found 6 matches⏎main.py:⏎
  2. agent 3.44
    rep<|arg|>pattern=mean<|tool_call_end|><|assistant_end|><|tool_start|>Found 3 matches⏎calc.py:⏎
  3. agent 3.36
    rep<|arg|>pattern=absolute<|tool_call_end|><|assistant_end|><|tool_start|>Found 3 matches⏎main.py:⏎
  4. agent 3.36
    <|arg|>pattern=double_all<|tool_call_end|><|assistant_end|><|tool_start|>Found 2 matches⏎main.py:⏎
  5. agent 3.32
    rep<|arg|>pattern=absolute<|tool_call_end|><|assistant_end|><|tool_start|>Found 6 matches⏎calc.py:⏎
  6. agent 3.31
    p<|arg|>pattern=LIMIT =<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎main.py:⏎
  7. agent 3.28
    rep<|arg|>pattern=excite<|tool_call_end|><|assistant_end|><|tool_start|>Found 3 matches⏎main.py:⏎
  8. agent 3.25
    <|arg|>pattern=max_of<|tool_call_end|><|assistant_end|><|tool_start|>Found 3 matches⏎main.py:⏎
  9. agent 3.2
    rep<|arg|>pattern=subtract<|tool_call_end|><|assistant_end|><|tool_start|>Found 2 matches⏎main.py:⏎
  10. agent 3.19
    <|arg|>pattern=NAME =<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎main.py:⏎
  11. agent 3.18
    rep<|arg|>pattern=length<|tool_call_end|><|assistant_end|><|tool_start|>Found 3 matches⏎strings.py:⏎
  12. agent 3.17
    rep<|arg|>pattern=initial<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎words.py:⏎