The people who have “way too much money” bought their homes long time ago and don’t contribute to new demand. They are not in the market to buy new homes. It’s completely irrelevant.
Speaking from experience, many of these people move up or sideways, regardless of the market. The buy/sell takes place under the same market conditions.