You don’t only lose if your equity is negative. You lose the opportunity cost of your downpayment and you lose the money you pay on your mortgage over what you would pay for a similar property in rent.