Skip to content
mini-lab
Features of prelude-2

Feature #2734

Fires on “ b” (not labeled yet: read the examples)

Fires on
0.36% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 45%
  • agent 29%
  • story 16%
  • chat 8%
  • worksheet 3%

Makes the model say

<|assistant_end|> commandlist<|assistant_start|><|system_start|> defines

Makes it not say

. next Python= not." no than

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 4.34
    ```⏎⏎Bug: `difference` should subtract b from a, but
  2. agent 4.16
    2<|tool_end|><|assistant_start|>`minus(a, b)` subtracts b from a.<|assistant_end|>
  3. python 4.15
    ```⏎⏎Bug: `difference` should subtract b from a, but
  4. python 4.01
    Bug: `sum_to` should return the sum of all the numbers from 0 to
  5. python 3.99
    ⏎`sum_up_to` returns the sum of all the numbers from 0 to
  6. python 3.94
    3.<|assistant_end|><|bos|>`minus(a, b)` subtracts b from a.⏎
  7. python 3.91
    (nums)⏎```⏎⏎Bug: `subtract` should subtract b from a, but
  8. python 3.88
    8<|think_end|>78<|assistant_end|><|bos|>Bug: `minus` should subtract b from a, but
  9. story 3.69
    her home at last. She was no longer anxious about cats bothering her.
  10. python 3.67
    ⏎ return a - b⏎```⏎⏎`subtract` subtracts b from a. For
  11. python 3.46
    ⏎`sum_up_to` returns the sum of all the numbers from 0 to
  12. story 3.46
    and called out, "Hey, Lily! Do you want to ride bikes with me