I have good friend from Boyle Heights.When he was starting off he did the same thing you are talking about with his first purchase. When he started a family he rented both units,which were cash flowing well, and moved into a nice suburban home . He has several rentals now. Lots of headaches with them too …but he is doing pretty well.
The sacrifice you make by living in one as opposed to renting or buying yourself a nicer private place is a great hedge, your cash flow will be very good. I think it will work out well for you.