Skip to content
mini-lab
Features of prelude-2

Feature #2253

Fires on “(” (not labeled yet: read the examples)

Fires on
1.74% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 59%
  • python 37%
  • chat 2%
  • worksheet 2%
  • story 1%

Makes the model say

(saYesrunnamestringsnums

Makes it not say

⏎ has add at Tom<|bos|> herhe

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 6.09
    <|tool_end|><|assistant_start|>Added `mean(a, b)`
  2. agent 5.87
    <|tool_end|><|assistant_start|>Added `evens(nums)` to `
  3. agent 5.8
    )<|tool_end|><|assistant_start|>Added `total(nums)` to `
  4. agent 5.72
    py (1 replacement)<|tool_end|><|assistant_start|>Added `initial(s)` to `
  5. agent 5.57
    return (a + b) / 2<|tool_end|><|assistant_start|>`minus(a, b)`
  6. agent 5.45
    case(s):⏎ return s<|arg|>newString=def upper_case(s):⏎ return
  7. agent 5.43
    , `tail(items)` and `mean_list(nums)`.<|assistant_end|><|user_start|>
  8. python 5.42
    <|assistant_end|><|bos|>```python⏎def double_all(nums):⏎ return
  9. agent 5.38
    1<|arg|>newString= return len(s)<|tool_call_end|><|assistant_end|>
  10. agent 5.33
    (half(LIMIT))⏎⏎⏎def min_of(a, b):
  11. agent 5.33
    upper()<|tool_end|><|assistant_start|>`shout(s)` makes s
  12. python 5.31
    can only tell short stories and add numbers.<|assistant_end|><|bos|>`minus(a, b)`