Feature #3291
Fires on “imes” (not labeled yet: read the examples)
- Fires on
- 0.72% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 33%
- agent 24%
- story 21%
- chat 20%
- worksheet 2%
Makes the model say
ed wass help past saw sees looked
Makes it not say
⏎ my! forgot forgetThank gone whole
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 2.95⏎⏎print(echo("tiger", 2))⏎print(bigger(7,
-
python 2.86even⏎⏎print(is_odd(6))⏎print(even(2))⏎
-
python 2.83, even⏎⏎print(even(4))⏎print(times(12,
-
python 2.82nums)⏎⏎⏎print(odd(6))⏎print(times(9,
-
python 2.81⏎⏎print(add_one(12))⏎print(product(5,
-
python 2.816⏎print(larger(9, 7))⏎print(sub_one(COUNT
-
python 2.78⏎print(echo("music", 2))⏎print(times(8,
-
python 2.75decrement⏎⏎print(decrement(1))⏎print(increment(7))⏎
-
python 2.75, cube⏎⏎print(cube(9))⏎print(minus(4,
-
story 2.7can I help you today?<|assistant_end|><|bos|>Once upon a time, in a tidy little farm,
-
python 2.69= 12⏎print(twice(8))⏎print(previous(LIMIT))⏎
-
story 2.67can I help you today?<|assistant_end|><|bos|>Once upon a time, in a small town, there