I’d be just as leery of your mortgage broker telling you it was a bad appraisal. Of course they’ll say that, if it means killing a deal and their commission.
If it were me, I would seriously re-evaluate prices in the area to make sure I’m really getting this house at a fair price and also seriously consider backing out if it turns out I aimed to high with my offer. Maybe make a new offer at the appraised price.