Aggregate unemployment numbers lack sufficient granularity to provide any useful insight. The linked data is not perfect, but look at the disparity between cities like Del Mar (5%) versus Escondido (10.5%). This is one reason why high end areas exhibit sticky prices, especially older established neighborhoods with limited new construction during the bubble years.
