You would also want to be careful if with non-permitted if you plan to make other changes to the house. When we bought our first house we were getting an HVAC installed (it didn’t have one at the time) and the city inspector would not sign off on the HVAC system until we agreed to tear down an existing grape arbor/patio cover that was not permitted. That is probably an extreme example (the guy was a real a$$) but if you plan to do any future work legitimately, the city or county inspectors could potentially take issue with the unpermitted things.
