Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1238

Fires on “.” (not labeled yet: read the examples)

Fires on
1.24% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 95%
  • chat 3%
  • python 1%
  • story 1%
  • worksheet 0%

Makes the model say

togetherad > result```]),ut

Makes it not say

⏎ mad sad<|arg|> letTiminitial took

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.49
    pattern=def lower_of<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎calc.py:⏎
  2. agent 3.43
    p<|arg|>pattern=def fact<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎arith.py:⏎
  3. agent 3.38
    pattern=def sum_to<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎utils.py:⏎
  4. agent 3.35
    p<|arg|>pattern=def square<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎calc.py:⏎
  5. agent 3.34
    <|arg|>pattern=def square<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎arith.py:⏎ Line
  6. agent 3.32
    p<|arg|>pattern=def square<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎utils.py:⏎
  7. agent 3.32
    pattern=def first_letter<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎strings.py:⏎
  8. agent 3.31
    p<|arg|>pattern=def smallest<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎items.py:⏎
  9. agent 3.3
    =def add_one<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎arith.py:⏎ Line
  10. agent 3.27
    pattern=def min_item<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎lists.py:⏎
  11. agent 3.26
    p<|arg|>pattern=def initial<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎greetings.py:⏎
  12. agent 3.26
    =def sum_to<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎arith.py:⏎ Line