Skip to content
mini-lab
Features of prelude-2

Feature #8

Fires on “ the” (not labeled yet: read the examples)

Fires on
0.55% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 37%
  • worksheet 23%
  • agent 18%
  • chat 16%
  • story 5%

Makes the model say

tests way l sail[::- used shortutils

Makes it not say

4 you `teries>>>appmd

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 6.87
    returns `[6]`.⏎⏎`total(nums)` adds up all the numbers in nums.
  2. python 6.73
    ⏎6⏎⏎`sum_list(nums)` adds up all the numbers in nums.
  3. python 6.72
    2⏎```⏎⏎Bug: `total` should add up all the numbers in nums,
  4. python 6.71
    ```⏎⏎Bug: `total` should add up all the numbers in nums,
  5. python 6.69
    a calculator.<|assistant_end|><|bos|>Bug: `total` should add up all the numbers in nums,
  6. python 6.47
    5`.⏎⏎`add_all(nums)` adds up all the numbers in nums.
  7. python 6.29
    return result⏎```⏎⏎`sum_list` adds up all the numbers in nums.
  8. python 6.27
    2`.⏎⏎`sum_list(nums)` adds up all the numbers in nums.
  9. python 6.09
    16.<|bos|>Bug: `total` should add up all the numbers in nums,
  10. python 5.94
    sum_list` should add up all the numbers in nums,
  11. python 5.8
    a dolphin.<|assistant_end|><|bos|>Bug: `total` should add up all the numbers in nums,
  12. python 5.35
    ```⏎⏎`factorial` multiplies all the numbers from 1