If I was planning on staying in San Diego for a long time, I would. I’d be buying at a reasonable price and at the same time taking advantage of historically low interest rates. I wouldn’t be paying outrageous property taxes either. I think your “catch” is really not a catch, it’s what has happened over longer periods of time.
