Agree with Fearful: If you have $500,000 cash and $10 million in total assets, you just buy the house you like for $1 mill – $1.5 mill. If you have $500,000 cash and your assets are now worth $4 million, you may just buy a $700K – $1 mill house.
Even the wealthy with cash are affected, and their markets will go down more.