Feature #31
Fires on “+” (not labeled yet: read the examples)
- Fires on
- 0.34% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 45%
- agent 18%
- chat 16%
- story 11%
- python 10%
Makes the model say
and fromnums to 's me two
Makes it not say
equals<|think_end|>_*. corner Pythoniver "!" someone
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 2.89How many apples does Tom have now?⏎87274+0003
-
worksheet 2.6950 plus 987?⏎56350+0098
-
worksheet 2.6661 + 29 is?⏎22661+0002
-
worksheet 2.65975 plus 58?⏎17975+0005
-
worksheet 2.6472 + 39 is?⏎22572+0003
-
worksheet 2.6201 + 22 is?⏎44501+0002
-
worksheet 2.52How many stickers does Ben have now?⏎58507+0008
-
worksheet 2.5108 and 223?⏎40908+0022
-
worksheet 2.49764 + 46.⏎87764+0004
-
worksheet 2.4842 and 188.⏎12742+0018
-
worksheet 2.4884 and 508.⏎21684+0050
-
worksheet 2.474 + 608 = ?⏎17744+0060