If you get just a recession prices might drop 10 or 15%, OK that would help, but it would be temporary and not enough for most to really feel affordable.

Without building (or over-building really) you are still left with more people than housing.