Feature #1176
Fires on “ of” (not labeled yet: read the examples)
- Fires on
- 0.29% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 48%
- worksheet 28%
- chat 13%
- story 8%
- agent 2%
Makes the model say
(Added Theirins thingcontentone pile
Makes it not say
bettered saidation0 blue "D
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 3.6126 is 104550.<|bos|>The sum of 83 and
-
worksheet 3.56a great adventure because of the special medicine.<|bos|>The sum of 5 and
-
worksheet 3.470 + 46 = 46.<|bos|>The sum of 6 and
-
python 3.28⏎⏎`count_items` returns the number of items. For example, `count_
-
worksheet 3.268 more. Now Anna has 98 cookies.<|bos|>The sum of 76 and
-
worksheet 3.235 and 1, you get 36.⏎The sum of 300
-
worksheet 3.23answer is 7.<|assistant_end|><|bos|>The sum of 277
-
worksheet 3.225<|think_end|>The answer is 695.<|assistant_end|><|bos|>The sum of 487
-
python 3.21⏎```⏎⏎`count` returns the number of items. For example, `count([
-
worksheet 3.244, you get 1234.⏎The sum of 619
-
worksheet 3.18899 is 75928.<|bos|>The sum of 883
-
python 3.17⏎⏎`how_many` returns the number of items. For example, `how_