I think you are off the mark. Look at many of the major golf tournaments and many residents rent there homes to large corporations and the area do not deteriorate.
The benefit of beach front property in San Diego is that you have student who are paying during the school year and high paying summer rentals for vacationers June to August.
Many people pay the years mortgage by renting beach front homes for a few months.