Skip to content
mini-lab
Features of prelude-2

Feature #566

Fires on “def” (not labeled yet: read the examples)

Fires on
0.69% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 68%
  • agent 29%
  • story 2%
  • chat 0%
  • worksheet 0%

Makes the model say

so evendef return7 is1 p

Makes it not say

<|arg|>expressionOUNTpositive):>divEXT

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 7.98
    but it has `return a * a`.⏎⏎```python⏎def product(a,
  2. python 7.78
    numbers, but it has `return a`.⏎⏎```python⏎def max_of(
  3. python 7.65
    numbers, but it has `return a`.⏎⏎```python⏎def max_of(
  4. python 7.47
    but it has `if a < b:`.⏎⏎```python⏎def max_of(
  5. python 7.45
    x)` returns the absolute value of x.⏎⏎```python⏎def abs_value(
  6. agent 7.36
    can I find biggest?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def biggest<|tool_call_end|><|assistant_end|><|tool_start|>
  7. python 7.34
    )` returns the average of a and b.⏎⏎```python⏎def average(a,
  8. python 7.31
    (s)` returns s in lower case.⏎⏎```python⏎def whisper(s):
  9. agent 7.29
    find join_words?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def join_words<|tool_call_end|>
  10. python 7.23
    has `return a + "" + b`.⏎⏎```python⏎def join_words(
  11. python 7.19
    has `return a + "" + b`.⏎⏎```python⏎def combine(a,
  12. python 7.19
    return sum(nums) / 2`.⏎⏎```python⏎def mean_list(