You’re actually in decent shape. You have a positive net worth, which is more than a LOT of people can say. However, it isn’t time for you to buy.
The only stigma attached to renting is in the minds of the ignorant. Financial security and knowledge are far more impressive, and anyone who pushes you to buy because they think it’s a sign of success is an idiot. Some of the wealthiest people in the world rent exclusively.
Your credit should be good in 3 years, and that should be your time frame. You should have no problem paying off the remainder of your debt and building up the down payment by then. It’s also likely that you’ll find yourself in a nicer place with a lower payment than if you bought today, and you’ll have actual equity. That’s a good feeling.