Feature #751
Fires on “ should” (not labeled yet: read the examples)
- Fires on
- 0.22% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 36%
- agent 31%
- chat 21%
- story 9%
- worksheet 3%
Makes the model say
tpatternitemscontentppedSpot<|think_end|>ked
Makes it not say
want feel pretty liked And yummy felt m
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 2.05" + name + "!"⏎```⏎⏎Bug: `triangle` should add up the numbers
-
python 2.04⏎ return a * b⏎```⏎⏎Bug: `halve` should return half of x
-
story 1.99brother, Max. Max wanted the napkin for his snack. "Give me the nap
-
python 1.9623<|think_end|>323<|assistant_end|><|bos|>Bug: `half` should return half of x
-
python 1.95⏎Bug: `exclaim` should add an exclamation mark
-
python 1.95by step or with a calculator.<|assistant_end|><|bos|>Bug: `total` should add up all the
-
python 1.93wearing their matching gray shoes.<|assistant_end|><|bos|>Bug: `product` should multiply a by b
-
python 1.93listlib.py⏎all tests passed⏎<|bos|>Bug: `power` should return a to the
-
python 1.87to tell stories and add numbers.<|assistant_end|><|bos|>Bug: `square` should return x squared,
-
python 1.863 main.py⏎12⏎<|bos|>Bug: `length` should return the length of
-
python 1.85acc⏎```⏎⏎Bug: `difference` should subtract b from a
-
python 1.85b⏎```⏎⏎Bug: `difference` should subtract b from a