I’ve gotta dispute that you have a “stable job”. It can be really surprising when you’re working along at what you think is a very stable job at a very stable company and the next day you wake up to news that your company is being: Merged, acquired, moved, etc..
If you’re lucky, you’ll hear about it in rumors, or the company will be totally public about it, but chances are that there could be nothing, and then a few months later you’re out the door looking for that next $100,000 a year job.
Now, you didn’t state that your wife worked, so I’ll assume that she doesn’t and that the $100,000/ yr. is all you’re getting. In my opinion, you need to also figure out what your monthly expenses on this house are (property tax, water, gas, electricity, mortgage payments, insurance, etc.) and think about the worst case scenario where you lose your job for any of the above mentioned reasons.