In reading your comments, it appears you and your wife really want this home, but that you are torn between what you want, and what you feel might be practical.
Over the past few years, and after losing several friends who were only in their 40’s, as I am, I have learned that life is extremely short, and EVERYTHING is temporary–so it is probably wise to enjoy each and every day.
On that basis, and since you both love the home, and since it appears this decision will bring you no financial hardship, I’d say–go for it!!
Our family made a decision over ten years ago, to move to a home we loved in Rancho Santa Fe, and it has been a dream come true for us. We’ve lived all over the world, but, for us, this is truly “home.”
Go with your heart, and enjoy your wonderful life!!!!