I would agree with xironman about the job market compared to the east coast or many other major markets. Also, a lot of people from the east coast move out here and find San Diego too slow, lacking in culture, diversity, etc. People even get tired of the sunshine – they miss the seasons. Not my opinion, just what a lot of people from bigger cities complain about and therefore leave SD to go back east or move to SF, LA, etc.
I would move here and evaluate neighborhoods as well as whether you see yourself here for many years to come before buying.