I’m not a lawyer, ttbomk, without an emergency they cannot enter without a warrant. A warrant would be issue, if they persue it, based on some probable cause from something visible they can verify from the outside. New windows, second electric meter, addition of a door, etc.
Nothing Gestapo like if you do some work that requires a permit and you didn’t obtain. Also nothing gestapo like if you converted a garage or something to ‘living space’.
Of course, the key learning here is be part of the community and get along with the neighbors.