Skip to content
mini-lab
Features of prelude-2

Feature #4036

Fires on “ range” (not labeled yet: read the examples)

Fires on
0.71% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 66%
  • agent 26%
  • story 3%
  • worksheet 3%
  • chat 2%

Makes the model say

+(_()` plus)::// its

Makes it not say

wayate<|assistant_end|>'re0return But dropped

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 4.36
    ⏎ for i in range(n +
  2. python 4.29
    ⏎from ops import sub_one, square, mean⏎⏎assert sub_one(1
  3. python 4.16
    (x):⏎ return x - 1⏎```⏎⏎>>> sub_one(7
  4. python 4.11
    ) == 6⏎assert sub_one(1
  5. agent 4.07
    newString= for i in range(1, n
  6. python 3.94
    ⏎from utils import sub_one, keep_even⏎⏎assert sub_one(2
  7. python 3.93
    sum_up_to, lower_of, difference⏎⏎assert sum_up_to
  8. python 3.86
    (n):⏎ acc = 0⏎ for i in range(n +
  9. python 3.82
    adds up the numbers from 0 to n. For example, `sum_up_to
  10. python 3.81
    ):⏎ result = 1⏎ for i in range(1, n
  11. python 3.8
    to` returns a to the power of b. For example, `raise_to(3
  12. python 3.79
    of all the numbers from 0 to n. For example, `sum_up_to