Skip to content
mini-lab
Features of prelude-2

Feature #462

Fires on “Bug” (not labeled yet: read the examples)

Fires on
0.45% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 54%
  • agent 40%
  • story 4%
  • chat 1%
  • worksheet 0%

Makes the model say

} Python (`:⏎ thereonfig exclamation

Makes it not say

first youispyally off trees

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 3.82
    ⏎code!⏎ROBOT⏎```<|assistant_end|><|bos|>Bug: `average_
  2. python 3.71
    (a, b):⏎ return a * b⏎```⏎⏎Bug: `cubed`
  3. python 3.68
    (a, b):⏎ return a ** b⏎```⏎⏎Bug: `smallest`
  4. python 3.67
    $ python3 test_listlib.py⏎all tests passed⏎<|bos|>Bug: `power`
  5. python 3.66
    $ python3 test_utils.py⏎all tests passed⏎<|bos|>Bug: `mean_
  6. python 3.56
    $ python3 test_calc.py⏎all tests passed⏎<|bos|>Bug: `join_
  7. python 3.48
    $ python3 test_words.py⏎all tests passed⏎<|bos|>Bug: `factorial`
  8. python 3.46
    b):⏎ return a % b == 0⏎```⏎⏎Bug: `sum_
  9. python 3.46
    def exclaim(s):⏎ return s + "!"⏎```⏎⏎Bug: `flip`
  10. python 3.44
    (a, b):⏎ return a ** b⏎```⏎⏎Bug: `shout`
  11. python 3.39
    [n * 2 for n in nums]⏎```⏎⏎Bug: `upper_
  12. python 3.38
    length(s):⏎ return len(s)⏎```⏎⏎Bug: `min_