The issue with Downtown San Diego is that it’s built around Conventions and Tourism. You have a bunch of hotels and restaurants catering to expense accounts.
This makes it very expensive for a city where many of it’s inhabitants that work government jobs and healthcare.