Feature #812
Fires on “'s” (not labeled yet: read the examples)
- Fires on
- 0.34% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 42%
- worksheet 25%
- agent 17%
- python 8%
- story 7%
Makes the model say
newString insideitem Today agreed stories$ front
Makes it not say
l2atCan1 =Hiopencode
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.18for a story!<|assistant_end|><|user_start|>What's your name?<|user_end|>
-
chat 3.16sky, and the sand was warm under their feet.<|assistant_end|><|user_start|>What's your name?<|user_end|>
-
chat 3.13is?<|user_end|><|assistant_start|>The answer is 48.<|assistant_end|><|user_start|>What's 56 +
-
worksheet 3.1114 + 96 = 6610.⏎Anna had 75
-
worksheet 3.09989, you get 6993.⏎What's 4 +
-
worksheet 3.05: I can only tell short stories and add numbers.<|assistant_end|><|bos|>What's 555
-
worksheet 3.038740 = 8747.⏎What's 651
-
worksheet 3.02made their planet a fun and happy place to be.<|assistant_end|><|bos|>What's 781
-
worksheet 2.98883 and 2 is 885.⏎What's 404
-
chat 2.97. I can only tell short stories and add numbers.<|assistant_end|><|user_start|>What's the weather like
-
chat 2.969<|tool_end|><|assistant_start|>The answer is 759.<|assistant_end|><|user_start|>What's 6 +
-
chat 2.95number only.<|system_end|><|user_start|>What's 4 +