But this argument is similar to saying that some people would be better off not wearing a seat belt because sometimes they trap people in a burning car.
Except not getting vaccines is worse, because of the already mentioned effect on herd immunity. You are not just putting yourself and children at risk, you are putting others at risk too.
The problem is that for some diseases the risk of the vaccine is actually greater than the risk of getting the disease, but this is only because the vaccine works so well. If people start to avoid the vaccine, this math changes quickly (as we all can see clearly now).