The dti ratio the bank used to approve your loan says you can afford it. The current ratio is fairly conservative. Maybe recalculate your tax benefit and you will fell better.
You should still be paying about what you would pay to rent a 500k home, so where is the discomfort?