“For those with more experience, has a decent neighborhood in central San Diego always been a tough market for 1st time buyers?”

What zip codes? Some areas in central SD have absolutely cratered and others have not. Schools tend to be a big negative in many but not all areas. In a lot of areas you should not have much trouble finding a house at rent parity but it will probably not be anything special and it will probably need some work.