Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1503

Fires on “ should” (not labeled yet: read the examples)

Fires on
1.07% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 43%
  • python 42%
  • story 12%
  • chat 2%
  • worksheet 1%

Makes the model say

returnre subtract double returnsterus defines

Makes it not say

little, B combine treats smile pretty perfect

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 6.34
    ` should return the average of
  2. python 6.28
    " + name + "!"⏎```⏎⏎Bug: `reverse` should reverse s, but
  3. python 6.14
    Bug: `combine` should join a and b
  4. python 6.13
    Bug: `max_item` should return the biggest item
  5. python 6.12
    return s[-1]⏎```⏎⏎Bug: `reverse` should return s reversed
  6. python 6.07
    ```⏎⏎Bug: `total` should add up all the
  7. python 5.97
    ⏎ return k⏎```⏎⏎Bug: `double_all` should return every number of
  8. python 5.96
    (s)⏎```⏎⏎Bug: `min_item` should return the smallest number
  9. python 5.9
    return min(nums)⏎```⏎⏎Bug: `doubled` should double every number in
  10. python 5.9
    ⏎ return s + "!"⏎```⏎⏎Bug: `flip` should reverse s, but
  11. python 5.9
    ⏎ return a + b⏎```⏎⏎Bug: `reverse` should reverse s, but
  12. python 5.81
    return s[0]⏎```⏎⏎Bug: `twice` should return x doubled,