Even if you buy your home with the lower rates but higher price etc… your property taxes can usually be reduced (although the prop 13 level or whatever they call that will be higher so it will go up quicker when the prices rise in the future).

Also I would think the higher rates will have less effect on the lower end housing market than the mid-high end.