Actually the regular buyers are the least of your problems. It is the people who will sacrifice return on the purchase just to get a home. They end up driving your prices up more then the regulars. Regulars have a threshold of return at which they will simply stop bidding. Those who are more novice tend to be the ones who kill bids.
