Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #4025

Fires on “ should” (not labeled yet: read the examples)

Fires on
0.46% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 47%
  • python 27%
  • story 11%
  • chat 8%
  • worksheet 7%

Makes the model say

returnreturn /ieryonRenameion

Makes it not say

up to4 birds very5⏎:

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 3.72
    2⏎```⏎⏎Bug: `is_divisible` should return True if a
  2. python 3.61
    Bug: `combine` should join a and b
  3. python 3.59
    name + "!"⏎```⏎⏎Bug: `join_words` should join a and b
  4. python 3.52
    The answer is 13.<|assistant_end|><|bos|>Bug: `power` should return a to the
  5. python 3.51
    + " " + b⏎```⏎⏎Bug: `vowels` should return the number of
  6. python 3.49
    listlib.py⏎all tests passed⏎<|bos|>Bug: `power` should return a to the
  7. python 3.49
    ⏎Bug: `vowels` should count the vowels in
  8. python 3.48
    ⏎ return b⏎```⏎⏎Bug: `raise_to` should return a to the
  9. python 3.48
    x * x * x⏎```⏎⏎Bug: `power` should return a to the
  10. python 3.47
    return x * 2⏎```⏎⏎Bug: `power` should return a to the
  11. python 3.43
    s.lower()⏎```⏎⏎Bug: `times` should return the product of
  12. python 3.43
    * i⏎ return result⏎```⏎⏎Bug: `power` should return a to the