Skip to content
mini-lab
Features of prelude-2

Feature #129

Fires on “1” (not labeled yet: read the examples)

Fires on
0.42% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 92%
  • chat 4%
  • story 2%
  • worksheet 2%
  • python 1%

Makes the model say

multipl she it<|tool_call_end|> nod replace defined glad

Makes it not say

manyhero count first other + own

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.99
    <|tool_call_start|>grep<|arg|>pattern=def hello<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎lib.
  2. agent 2.97
    <|tool_call_start|>grep<|arg|>pattern=def includes<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎lists.
  3. agent 2.96
    <|tool_call_start|>grep<|arg|>pattern=def exclaim<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎hello.
  4. agent 2.92
    <|tool_call_start|>grep<|arg|>pattern=def doubled<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎helpers.
  5. agent 2.9
    rep<|arg|>pattern=def lower_of<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎calc.
  6. agent 2.89
    <|tool_call_start|>grep<|arg|>pattern=def cube<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎math_
  7. agent 2.89
    <|tool_call_start|>grep<|arg|>pattern=def biggest<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎lists.
  8. agent 2.88
    <|tool_call_start|>grep<|arg|>pattern=def larger<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎script.
  9. agent 2.88
    <|tool_call_start|>grep<|arg|>pattern=def fact<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎number_
  10. agent 2.87
    'lenggth' is not defined. Did you mean: 'length'?
  11. agent 2.84
    rep<|arg|>pattern=def has_item<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎items.
  12. agent 2.84
    <|tool_call_start|>grep<|arg|>pattern=def biggest<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎listlib.