Feature #4036
Fires on “ range” (not labeled yet: read the examples)
- Fires on
- 0.71% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 66%
- agent 26%
- story 3%
- worksheet 3%
- chat 2%
Makes the model say
+(_()` plus)::// its
Makes it not say
wayate<|assistant_end|>'re0return But dropped
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 4.36⏎ for i in range(n +
-
python 4.29⏎from ops import sub_one, square, mean⏎⏎assert sub_one(1
-
python 4.16(x):⏎ return x - 1⏎```⏎⏎>>> sub_one(7
-
python 4.11) == 6⏎assert sub_one(1
-
agent 4.07newString= for i in range(1, n
-
python 3.94⏎from utils import sub_one, keep_even⏎⏎assert sub_one(2
-
python 3.93sum_up_to, lower_of, difference⏎⏎assert sum_up_to
-
python 3.86(n):⏎ acc = 0⏎ for i in range(n +
-
python 3.82adds up the numbers from 0 to n. For example, `sum_up_to
-
python 3.81):⏎ result = 1⏎ for i in range(1, n
-
python 3.8to` returns a to the power of b. For example, `raise_to(3
-
python 3.79of all the numbers from 0 to n. For example, `sum_up_to