Start smaller and move up. Especially if you are starting at a time when prices are high.
After I pay off my primary in Carmel v, I am going to buy a bigger house elsewhere. With as little down as possible. Worst comes to worst, if I can’t make payments, I’ll just jingle the keys right back to the bank. Just kidding.. Sort of…