We lived in San Diego for a decade+ before moving to LA. We lived in Central / Central Coastal San Diego (Clairement, then Bay Park) and didn’t want to live too far inland for climate purposes. This pointed us to areas like Santa Monica, Manhattan Beach, etc (which were a bit too expensive). But we found some nice pockets on LA’s west side that are really nice places to live. You shouldn’t omit these areas in your search.
The places you are looking are nice, but to me the heat and air quality in places like Pasadena overcame the positives you’ve already mentioned.
