Welcome bay area person to this forum…I think it’s the most helpful housing forum if you’re looking to move to SD.
I’d recommend you actually rent a place first and just live with “throwing money in the toilet” for at least a year to see how the job turns out to be and how you like/dislike the area…
I think quite a few people here have lived/worked in the bay area as well to give you possibly a more objective comparison.