I pulled out of a house about a year and a half ago on an accepted offer by the seller. I pulled because I made the offer with only my wife seeing the house. After walking it myself, I came to the conclusion that i didnt want to pay that much for that house.
The day following our offer being pulled the seller dropped the price by 30K. I had my realtor resubmit an offer at that price and the selling realtor didnt like that and rejected it.
Now looking back on it, Im glad we passed bc it bordered an undeveloped subdivision and that subdivision has started building so there is constant noise and traffic in that area. The price of that home is negatively impacted as well bc the bordering subdivision has larger homes for slightly more money but no MR whereas the home we bid on had rather high MR.
This may be a different scenario than yours since the sales price was dropped prior to us resubmitting lower. You didnt specify if yours did that or not. You may piss off the selling realtor and seller but its not like you have some obligation to either of them and this shouldnt be looked at as a reflection of your realtor but rather you the buyer.