Feature #199
Fires on “,” (not labeled yet: read the examples)
- Fires on
- 0.67% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 50%
- worksheet 27%
- agent 11%
- chat 10%
- story 2%
Makes the model say
and, to excited happy): at here
Makes it not say
")`<|think_start|>alseFixed`, calculatorsmallCreate
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 3.23tail⏎⏎assert tail([8, 2,
-
python 3.18len(nums)⏎```⏎⏎>>> mean_list([2, 4,
-
python 3.15is_odd⏎⏎assert last([8, 8,
-
python 3.122, 4]) == 4⏎assert tail([5, 5,
-
python 3.03⏎```⏎⏎>>> evens([3, 7,
-
python 3.02len(nums)⏎```⏎⏎>>> mean_list([5, 7,
-
python 2.992, 5]) == 2⏎assert last([7, 7,
-
python 2.971, 3]) == 3⏎assert tail([6, 7,
-
python 2.92min(nums)⏎```⏎⏎>>> min_item([3, 9,
-
python 2.9len(nums)⏎```⏎⏎>>> average_list([3, 8,
-
python 2.88⏎ return items[-1]⏎```⏎⏎>>> last([3, 7,
-
python 2.877, 3]) == 6⏎assert first([3, 6,