In theory, the governing authority (city or county – depending on your location) can have you take out/tear down the unpermitted stuff. Or they can have you pay for inspections to them and require you to do the work to bring it up to code.

Lots of unpermitted work out there – if it was done to code and zoning rules you might be able to keep the unpermitted additions.