Skip to content
mini-lab
Features of prelude-2

Feature #1315

Fires on “ return” (not labeled yet: read the examples)

Fires on
0.77% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 47%
  • python 46%
  • story 3%
  • chat 2%
  • worksheet 2%

Makes the model say

tests`, Renamedcalculatorpath{tract

Makes it not say

girl⏎ show f hand hard c sister

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 2.66
    ```⏎<|bos|>Bug: `mean_list` should return the average of nums
  2. python 2.59
    items)⏎```⏎⏎Bug: `average_list` should return the average of nums
  3. python 2.57
    x > 0⏎```⏎⏎Bug: `squared` should return x squared, but
  4. python 2.57
    Bug: `mean_list` should return the average of nums
  5. python 2.52
    nums)⏎```⏎⏎Bug: `add_all` should return the sum of the
  6. python 2.51
    OT⏎```<|assistant_end|><|bos|>Bug: `average_list` should return the average of nums
  7. python 2.5
    4])⏎4⏎⏎`average_list(nums)` returns the average of nums
  8. python 2.49
    You're welcome!<|assistant_end|><|bos|>Bug: `average_list` should return the average of nums
  9. python 2.49
    / len(nums)⏎```⏎⏎`average_list` returns the average of nums
  10. python 2.48
    nums]⏎```⏎⏎Bug: `add_all` should return the sum of the
  11. python 2.48
    0]⏎```⏎⏎Bug: `mean_list` should return the average of nums
  12. python 2.45
    / len(nums)⏎```⏎⏎`average_list` returns the average of nums