You guys are having a baby soon; the price is 300K higher than your initial target; your family hate looking at it… My gut feeling is don’t do it. Why pay a “shocking” price for something your family had “an extremely negative reaction” to? If you hate it already before buying it, my guess is you’ll have an enormous buyer’s remorse afterwards.
In a crazy situation like this one, more often than not the best action is do nothing, definitely not making a HUGE commitment like this.