America will still buy houses if MID was eliminated/reduced. The only issue is that limiting/eliminating MID will cause house values to fall, because the subsidy in the form of MID inflated value of the house.
Thus any proposal to mess up with MID will invite resistance from every homeowner in USA, regardless of whether they have a mortgage or not, whether they own second home or not, whether they make 250K+ or not! Homeowners are about 60+% of population! That is more numerous than other sacred cows in the tax code: business tax shelters, student loans, social security, medicare, farmers-industrial complex, military-industrial complex, healthcare-industrial complex, labor-industrial complex ….
I suspect that other things will be in the line of fire before they reach MID.