Considering that most of the bad experiences are created by a few people, it wouldn’t be hard to get rid of the bad actors. Chances are, most of the reports would be about the same few people.
I do think people should have the right to be unmolested, if they post clear signs against soliciting, whereupon solicitors could be treated as trespassers. But unless threats, burglary, fraud, or similar things are involved, I don’t think that solicitation should automatically be cause for a police call in the absence of signs put out by the homeowner prohibiting the same.