Feature #49
Fires on “ of” (not labeled yet: read the examples)
- Fires on
- 0.72% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 40%
- python 31%
- worksheet 11%
- chat 10%
- story 8%
Makes the model say
at sun-ensed play one
Makes it not say
=**/*.emo uponICalculator_$new
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 3.5sum of the numbers in
-
worksheet 3.5sum of 68
-
python 3.21had met that day.<|bos|>`total(nums)` returns the sum of the numbers in nums
-
worksheet 2.95_core.py⏎all tests passed⏎<|bos|>What is the sum of 735
-
worksheet 2.91acc + i⏎ return acc⏎```⏎<|bos|>What is the sum of 52 and
-
chat 2.89main.py⏎[4]⏎<|bos|><|user_start|>What is the sum of 858
-
chat 2.86<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Find the sum of 417
-
worksheet 2.867, 79<|think_end|>79<|assistant_end|><|bos|>What is the sum of 409
-
chat 2.82_of(a, b)`.<|assistant_end|><|bos|><|user_start|>What is the sum of 5 and
-
python 2.8288.<|assistant_end|><|bos|>Bug: `add` should return the sum of a and b,
-
worksheet 2.81together is much more fun than playing alone.<|bos|>What is the sum of 1 and
-
chat 2.81<|system_start|>Start every answer with "Sure!".<|system_end|><|user_start|>What is the sum of 637