Getting a better leash he can’t get free of would probably make people more comfortable. Consider getting a muzzle for situations where the dog will be out in public. It may not seem “fair” to the dog, but if your primary concern is the comfort of others, it may be a necessity.
The majority of Pit Bulls are well mannered, perhaps slightly “spunky” dogs. Many do have some aggression problems with other dogs, but so does my Lab. Generally other dog owners should be understanding, although you do get the occasional stupid owner who walks their dog off-leash and gets upset when their “friendly” dog runs up to a less friendly dog and the two get in an argument.
The flip side is Pit Bulls and Rottweilers are responsible for over 50% of dog caused human fatalities. Part of this is probably self-selection, as bad owners who want to train their dog to fight or to attack intruders are more likely to pick a Pit Bull. Pit Bulls do have a reasonably fair reputation of being fiercely loyal but territorial and distrusting of strangers.
So in general your options are a muzzle or to really engage in a PR campaign to get your neighbors to meet your dog so they can see it as an individual rather than just another Pit.